Nov 05 14:57:29 devstack cinder-volume[76088]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 14:57:29 devstack cinder-volume[76088]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 14:57:29 devstack cinder-volume[76088]: we strongly recommend against using it for new projects.
Nov 05 14:57:29 devstack cinder-volume[76088]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 14:57:29 devstack cinder-volume[76088]: framework.  For more detail see
Nov 05 14:57:29 devstack cinder-volume[76088]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 14:57:29 devstack cinder-volume[76088]:   import eventlet  # noqa
Nov 05 14:57:32 devstack cinder-volume[76088]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76088) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 14:57:32 devstack cinder-volume[76088]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76088) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 14:57:32 devstack cinder-volume[76088]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76088) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 14:57:33 devstack cinder-volume[76088]: INFO dbcounter [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Registered counter for database cinder
Nov 05 14:57:33 devstack cinder-volume[76088]: DEBUG oslo_db.sqlalchemy.engines [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76088) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 14:57:33 devstack cinder-volume[76088]: DEBUG dbcounter [-] [76088] Writer thread running {{(pid=76088) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 14:57:33 devstack cinder-volume[76088]: INFO cinder.rpc [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 14:57:33 devstack cinder-volume[76088]: INFO cinder.rpc [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 14:57:33 devstack cinder-volume[76088]: DEBUG oslo_db.sqlalchemy.engines [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76088) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 14:57:33 devstack cinder-volume[76088]: INFO cinder.volume.manager [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Determined volume DB was empty at startup.
Nov 05 14:57:33 devstack cinder-volume[76088]: DEBUG cinder.volume.manager [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76088) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 05 14:57:33 devstack cinder-volume[76088]: INFO cinder.volume.manager [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 05 14:57:33 devstack cinder-volume[76088]: WARNING stevedore.named [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 14:57:33 devstack cinder-volume[76088]: WARNING castellan.key_manager [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 14:57:33 devstack cinder-volume[76088]: WARNING cinder.keymgr.conf_key_mgr [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 14:57:33 devstack cinder-volume[76088]: DEBUG cinder.volume.drivers.lvm [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76088) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Nov 05 14:57:33 devstack cinder-volume[76088]: DEBUG oslo_concurrency.processutils [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76088) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_concurrency.processutils [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] CMD "cinder-rtstool verify" returned: 0 in 0.402s {{(pid=76088) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_db.sqlalchemy.engines [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76088) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 14:57:34 devstack cinder-volume[76088]: INFO cinder.rpc [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Nov 05 14:57:34 devstack cinder-volume[76088]: INFO cinder.rpc [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Nov 05 14:57:34 devstack cinder-volume[76088]: WARNING stevedore.named [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 14:57:34 devstack cinder-volume[76088]: WARNING castellan.key_manager [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 14:57:34 devstack cinder-volume[76088]: INFO cinder.volume.manager [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_db.sqlalchemy.engines [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76088) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 14:57:34 devstack cinder-volume[76088]: INFO oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Starting 1 workers
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Started child 76239 {{(pid=76088) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Full set of CONF: {{(pid=76088) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] ******************************************************************************** {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Configuration options gathered from: {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] ================================================================================ {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 14:57:34 devstack cinder-volume[76239]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] allow_availability_zone_fallback = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] allow_compression_on_image_upload = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] allowed_direct_url_schemes     = [] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] api_rate_limit                 = True {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] auth_strategy                  = keystone {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] az_cache_duration              = 3600 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_availability_zone      = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_host                   = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_name                   = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_stats_polling_interval = 60 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backup_api_class               = cinder.backup.api.API {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backup_name_template           = backup-%s {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backup_use_same_host           = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backup_use_temp_snapshot       = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] chap_password                  = **** {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] chap_username                  =  {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cinder_internal_tenant_project_id = 38bbdcaf4f364f189e853f075f0ad47b {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cinder_internal_tenant_user_id = 0d20b209ecf04040a036e0c6fa2be821 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cloned_volume_same_az          = True {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cluster                        = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] compression_format             = gzip {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] compute_api_class              = cinder.compute.nova.API {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] config_dir                     = [] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] config_source                  = [] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] control_exchange               = openstack {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] debug                          = True {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] default_availability_zone      = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] default_group_type             = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] default_volume_type            = lvmdriver-1 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] disk_geometry                  = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] driver_client_cert             = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] driver_client_cert_key         = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] driver_data_namespace          = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] driver_ssl_cert_path           = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] driver_ssl_cert_verify         = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] driver_use_ssl                 = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] enable_force_upload            = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] enable_new_services            = True {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] enable_unsupported_driver      = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] enforce_multipath_for_image_xfer = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] filter_function                = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] glance_api_insecure            = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] glance_api_servers             = ['http://192.168.122.140/image'] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] glance_api_ssl_compression     = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] glance_ca_certificates_file    = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] glance_catalog_info            = image:glance:publicURL {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] glance_certfile                = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] glance_keyfile                 = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] glance_num_retries             = 3 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] glance_request_timeout         = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] goodness_function              = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] graceful_shutdown_timeout      = 5 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] group_api_class                = cinder.group.api.API {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] host                           = devstack {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] image_compress_on_upload       = True {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] image_conversion_address_space_limit = 1 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] image_conversion_cpu_limit     = 60 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] image_conversion_disable       = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] image_introspection_address_space_limit = 1 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] image_introspection_cpu_limit  = 60 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] image_upload_use_cinder_backend = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] image_upload_use_internal_tenant = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] image_volume_cache_enabled     = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] image_volume_cache_max_count   = 0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] image_volume_cache_max_size_gb = 0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] init_host_max_objects_retrieval = 0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] instance_format                = [instance: %(uuid)s]  {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] iscsi_target_flags             =  {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] iscsi_write_cache              = on {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] iser_helper                    = tgtadm {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] iser_ip_address                = 192.168.122.140 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] iser_port                      = 3260 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] log_color                      = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] log_config_append              = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] log_dir                        = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] log_file                       = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] log_options                    = True {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] log_rotate_interval            = 1 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] log_rotate_interval_type       = days {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] log_rotation_type              = none {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] max_age                        = 0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] max_logfile_count              = 30 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] max_logfile_size_mb            = 200 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] max_over_subscription_ratio    = 20.0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] message_reap_interval          = 86400 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] message_ttl                    = 2592000 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] migration_create_volume_timeout_secs = 300 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] monkey_patch                   = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] monkey_patch_modules           = [] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] my_ip                          = 192.168.122.140 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] no_snapshot_gb_quota           = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] num_iser_scan_tries            = 3 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] num_shell_tries                = 3 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] num_volume_device_scan_tries   = 3 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] nvmeof_conn_info_version       = 1 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] nvmet_ns_id                    = 10 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] nvmet_port_id                  = 1 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] osapi_max_limit                = 1000 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] osapi_volume_ext_list          = [] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] osapi_volume_listen_port       = 8776 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] osapi_volume_use_ssl           = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] osapi_volume_workers           = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] per_volume_size_limit          = -1 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] periodic_fuzzy_delay           = 60 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] periodic_interval              = 60 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] public_endpoint                = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] publish_errors                 = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] quota_backup_gigabytes         = 1000 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] quota_backups                  = 10 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] quota_gigabytes                = 1000 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] quota_groups                   = 10 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] quota_snapshots                = 10 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] quota_volumes                  = 10 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] rate_limit_burst               = 0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] rate_limit_except_level        = CRITICAL {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] rate_limit_interval            = 0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] reinit_driver_count            = 3 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] replication_device             = **** {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] report_discard_supported       = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] report_interval                = 120 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] reservation_clean_interval     = 86400 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] reservation_expire             = 86400 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] reserved_image_namespaces      = [] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] reserved_percentage            = 0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] rpc_response_timeout           = 120 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] run_external_periodic_tasks    = True {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] scst_target_driver             = iscsi {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] scst_target_iqn_name           = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] service_down_time              = 720 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] shell_completion               = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] snapshot_name_template         = snapshot-%s {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] snapshot_same_host             = True {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] split_loggers                  = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] state_path                     = /opt/stack/data/cinder {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] storage_availability_zone      = nova {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] storage_protocol               = iSCSI {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] syslog_log_facility            = LOG_USER {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] target_helper                  = lioadm {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] target_ip_address              = 192.168.122.140 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] target_port                    = 3260 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] target_protocol                = iscsi {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] target_secondary_ip_addresses  = [] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] trace_flags                    = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76239]: INFO cinder.volume.manager [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] transport_url                  = **** {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] until_refresh                  = 0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] use_chap_auth                  = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] use_default_quota_class        = True {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] use_journal                    = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] use_json                       = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] use_multipath_for_image_xfer   = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] use_stderr                     = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] use_syslog                     = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] verify_glance_signatures       = enabled {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] volume_api_class               = cinder.volume.api.API {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] volume_backend_name            = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] volume_clear                   = zero {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] volume_clear_ionice            = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] volume_clear_size              = 0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] volume_copy_bps_limit          = 0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] volume_dd_blocksize            = 1M {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] volume_name_template           = volume-%s {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] volume_service_inithost_offload = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] volume_usage_audit_period      = month {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] zoning_mode                    = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_concurrency.disable_process_locking = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.auth_section = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.auth_type   = password {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.auth_version = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.cache       = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.certfile    = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.delay_auth_decision = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.http_connect_timeout = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.include_service_catalog = True {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.insecure    = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.interface   = public {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.keyfile     = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.memcache_password = **** {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.memcache_username = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.region_name = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.service_token_roles_required = True {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.service_type = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.token_cache_time = 300 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.140/identity {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.backend                  = dogpile.cache.null {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.backend_argument         = **** {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.backend_expiration_time  = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.config_prefix            = cache.oslo {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.debug_cache_backend      = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.enable_retry_client      = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.enable_socket_keepalive  = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.enabled                  = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.expiration_time          = 600 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.hashclient_retry_attempts = 2 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.memcache_dead_retry      = 300 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.memcache_pool_maxsize    = 10 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.memcache_sasl_enabled    = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.password                 = **** {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.proxies                  = [] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.redis_db                 = 0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.redis_sentinel_service_name = mymaster {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.051s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.redis_server             = localhost:6379 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.retry_attempts           = 2 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.retry_delay              = 0.0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.socket_keepalive_count   = 1 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.socket_keepalive_idle    = 1 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.socket_keepalive_interval = 1 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.socket_timeout           = 1.0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.tls_allowed_ciphers      = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.tls_cafile               = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.tls_certfile             = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.tls_enabled              = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.tls_keyfile              = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cache.username                 = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] coordination.backend_url       = **** {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] database.asyncio_connection    = **** {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] database.asyncio_slave_connection = **** {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] database.backend               = sqlalchemy {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] database.connection            = **** {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] database.connection_debug      = 0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] database.connection_parameters =  {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] database.connection_recycle_time = 3600 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] database.connection_trace      = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] database.db_inc_retry_interval = True {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] database.db_max_retries        = 20 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] database.db_max_retry_interval = 10 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] database.db_retry_interval     = 1 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] database.max_overflow          = 50 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] database.max_pool_size         = 5 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] database.max_retries           = 10 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] database.mysql_wsrep_sync_wait = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] database.pool_timeout          = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] database.retry_interval        = 10 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] database.slave_connection      = **** {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] database.sqlite_synchronous    = True {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] database.synchronous_reader    = True {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] database.use_db_reconnect      = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_tracing.insecure = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] profiler.connection_string     = messaging:// {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] profiler.enabled               = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] profiler.es_doc_type           = notification {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] profiler.es_scroll_size        = 10000 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] profiler.es_scroll_time        = 2m {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] profiler.filter_error_trace    = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] profiler.hmac_keys             = **** {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] profiler.sentinel_service_name = mymaster {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] profiler.socket_timeout        = 0.1 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] profiler.trace_requests        = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] profiler.trace_sqlalchemy      = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] profiler_jaeger.process_tags   = {} {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] profiler_jaeger.service_name_prefix = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] profiler_otlp.service_name_prefix = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_policy.enforce_new_defaults = True {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_policy.policy_default_rule = default {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_policy.policy_file        = policy.yaml {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] privsep_osbrick.group          = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] privsep_osbrick.helper_command = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] privsep_osbrick.user           = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cinder_sys_admin.group         = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cinder_sys_admin.helper_command = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] cinder_sys_admin.user          = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] service_user.auth_section      = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] service_user.auth_type         = password {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] service_user.cafile            = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] service_user.certfile          = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] service_user.collect_timing    = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] service_user.insecure          = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] service_user.keyfile           = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] service_user.send_service_user_token = True {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] service_user.split_loggers     = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] service_user.timeout           = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] service_user.tls_ciphers       = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] service_user.tls_min_version   = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] glance.auth_section            = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] glance.auth_type               = password {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] glance.certfile                = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] glance.collect_timing          = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] glance.insecure                = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] glance.keyfile                 = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] glance.region_name             = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] glance.split_loggers           = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] glance.timeout                 = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] glance.tls_ciphers             = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] glance.tls_min_version         = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.backend_availability_zone = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.chap_password = **** {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.chap_username =  {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.disk_geometry = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.driver_client_cert = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.driver_client_cert_key = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.driver_data_namespace = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.driver_use_ssl = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.enable_unsupported_driver = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.extra_capabilities = {} {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.filter_function = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.goodness_function = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.iscsi_target_flags =  {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.iscsi_write_cache = on {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.iser_helper   = tgtadm {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.iser_ip_address = 192.168.122.140 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.iser_port     = 3260 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.lvm_share_target = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.lvm_type      = auto {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.num_shell_tries = 3 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.nvmet_port_id = 1 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.replication_device = **** {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.report_discard_supported = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.reserved_percentage = 0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.scst_target_driver = iscsi {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.scst_target_iqn_name = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.storage_protocol = iSCSI {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.target_helper = tgtadm {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.target_ip_address = 192.168.122.140 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.target_port   = 3260 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.target_protocol = iscsi {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.trace_flags   = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.unique_fqdn_network = True {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.use_chap_auth = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.volume_backend_name = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.volume_clear  = zero {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.volume_clear_ionice = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.volume_clear_size = 0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_reports.file_event_handler = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_reports.log_dir           = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.backend_availability_zone = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.backend_host       = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.chap_password      = **** {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.chap_username      = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.disk_geometry      = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.driver_client_cert = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.driver_data_namespace = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.extra_capabilities = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.filter_function    = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.goodness_function  = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.iser_helper        = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.iser_ip_address    = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.iser_port          = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.iser_target_prefix = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.lvm_share_target   = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.lvm_type           = auto {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.num_shell_tries    = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.replication_device = **** {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.report_discard_supported = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.reserved_percentage = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.scst_target_driver = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.storage_protocol   = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.target_helper      = lioadm {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.target_ip_address  = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.target_port        = 3260 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.trace_flags        = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.use_chap_auth      = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.volume_clear       = zero {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.volume_clear_size  = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] lvmdriver-1.volumes_dir        = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack sudo[76243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.ssl      = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack sudo[76243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_notifications.driver = [] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_notifications.retry = -1 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] oslo_messaging_notifications.transport_url = **** {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] key_manager.fixed_key          = **** {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican.barbican_api_version  = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican.barbican_endpoint     = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican.barbican_endpoint_type = public {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican.barbican_region_name  = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican.cafile                = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican.certfile              = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican.collect_timing        = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican.insecure              = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican.keyfile               = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican.number_of_retries     = 60 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican.retry_delay           = 1 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican.send_service_user_token = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican.split_loggers         = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican.timeout               = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican.tls_ciphers           = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican.tls_min_version       = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican.verify_ssl            = True {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican.verify_ssl_path       = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican_service_user.auth_section = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican_service_user.auth_type = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican_service_user.cafile   = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican_service_user.certfile = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican_service_user.collect_timing = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican_service_user.insecure = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican_service_user.keyfile  = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican_service_user.split_loggers = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican_service_user.timeout  = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican_service_user.tls_ciphers = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] barbican_service_user.tls_min_version = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] vault.approle_role_id          = **** {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] vault.approle_secret_id        = **** {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] vault.auth_method              = approle {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] vault.auth_path                = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] vault.kv_mountpoint            = secret {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] vault.kv_path                  = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] vault.kv_version               = 2 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] vault.namespace                = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] vault.root_token_id            = **** {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] vault.ssl_ca_crt_file          = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] vault.timeout                  = 60.0 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] vault.token_file               = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] vault.token_role               = None {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] vault.use_ssl                  = False {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 14:57:34 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] ******************************************************************************** {{(pid=76088) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 14:57:35 devstack sudo[76243]: pam_unix(sudo:session): session closed for user root
Nov 05 14:57:35 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.391s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:35 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:35 devstack sudo[76371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 14:57:35 devstack sudo[76371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:57:35 devstack sudo[76371]: pam_unix(sudo:session): session closed for user root
Nov 05 14:57:35 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.258s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:35 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 14:57:35 devstack cinder-volume[76239]: INFO cinder.brick.local_dev.lvm [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Nov 05 14:57:35 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:35 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:35 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:35 devstack sudo[76475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 14:57:35 devstack sudo[76475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:57:35 devstack sudo[76475]: pam_unix(sudo:session): session closed for user root
Nov 05 14:57:35 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:35 devstack cinder-volume[76239]: DEBUG cinder.brick.local_dev.lvm [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76239) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Nov 05 14:57:35 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:35 devstack sudo[76555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 14:57:35 devstack sudo[76555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:57:36 devstack sudo[76555]: pam_unix(sudo:session): session closed for user root
Nov 05 14:57:36 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.513s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:36 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:36 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:36 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:36 devstack sudo[76751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 14:57:36 devstack sudo[76751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:57:36 devstack sudo[76751]: pam_unix(sudo:session): session closed for user root
Nov 05 14:57:36 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.316s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:36 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:36 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:36 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:36 devstack sudo[76855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Nov 05 14:57:36 devstack sudo[76855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:57:36 devstack sudo[76855]: pam_unix(sudo:session): session closed for user root
Nov 05 14:57:36 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.247s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:36 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:36 devstack sudo[76858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 14:57:36 devstack sudo[76858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:57:37 devstack sudo[76858]: pam_unix(sudo:session): session closed for user root
Nov 05 14:57:37 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.336s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:37 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:37 devstack sudo[76943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 14:57:37 devstack sudo[76943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:57:37 devstack sudo[76943]: pam_unix(sudo:session): session closed for user root
Nov 05 14:57:37 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:37 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:37 devstack sudo[76948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 14:57:37 devstack sudo[76948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:57:37 devstack sudo[76948]: pam_unix(sudo:session): session closed for user root
Nov 05 14:57:37 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:37 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:37 devstack sudo[77028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 14:57:37 devstack sudo[77028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:57:37 devstack sudo[77028]: pam_unix(sudo:session): session closed for user root
Nov 05 14:57:37 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:37 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:37 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:37 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:37 devstack sudo[77040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 14:57:37 devstack sudo[77040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:57:38 devstack sudo[77040]: pam_unix(sudo:session): session closed for user root
Nov 05 14:57:38 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.315s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:38 devstack cinder-volume[76239]: INFO cinder.volume.drivers.lvm [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Nov 05 14:57:38 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:38 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:38 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:38 devstack sudo[77044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 14:57:38 devstack sudo[77044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:57:38 devstack sudo[77044]: pam_unix(sudo:session): session closed for user root
Nov 05 14:57:38 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:38 devstack cinder-volume[76239]: DEBUG cinder.volume.drivers.lvm [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Updating volume stats {{(pid=76239) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 14:57:38 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:38 devstack sudo[77053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 14:57:38 devstack sudo[77053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:57:38 devstack sudo[77053]: pam_unix(sudo:session): session closed for user root
Nov 05 14:57:38 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:38 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:38 devstack sudo[77056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 14:57:38 devstack sudo[77056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:57:39 devstack sudo[77056]: pam_unix(sudo:session): session closed for user root
Nov 05 14:57:39 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:39 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:39 devstack sudo[77059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 14:57:39 devstack sudo[77059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:57:39 devstack sudo[77059]: pam_unix(sudo:session): session closed for user root
Nov 05 14:57:39 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:39 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:39 devstack sudo[77062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 14:57:39 devstack sudo[77062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:57:39 devstack sudo[77062]: pam_unix(sudo:session): session closed for user root
Nov 05 14:57:39 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:39 devstack cinder-volume[76239]: INFO cinder.volume.driver [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 14:57:39 devstack cinder-volume[76239]: DEBUG cinder.volume.driver [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76239) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 14:57:39 devstack cinder-volume[76239]: DEBUG oslo_db.sqlalchemy.engines [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76239) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 14:57:39 devstack cinder-volume[76239]: DEBUG dbcounter [-] [76239] Writer thread running {{(pid=76239) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 14:57:39 devstack cinder-volume[76239]: DEBUG cinder.db.api [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Building query based on filter {{(pid=76239) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 05 14:57:39 devstack cinder-volume[76239]: DEBUG cinder.image.image_utils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76239) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 05 14:57:39 devstack cinder-volume[76239]: INFO cinder.keymgr.migration [None req-0456fec9-3d0d-473d-ba93-5a558b8a475a None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 14:57:39 devstack cinder-volume[76239]: DEBUG cinder.volume.drivers.lvm [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Updating volume stats {{(pid=76239) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 14:57:39 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:39 devstack sudo[77065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 14:57:39 devstack sudo[77065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:57:39 devstack sudo[77065]: pam_unix(sudo:session): session closed for user root
Nov 05 14:57:39 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:39 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:39 devstack sudo[77070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 14:57:39 devstack sudo[77070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:57:40 devstack sudo[77070]: pam_unix(sudo:session): session closed for user root
Nov 05 14:57:40 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:40 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:40 devstack sudo[77074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 14:57:40 devstack sudo[77074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:57:40 devstack sudo[77074]: pam_unix(sudo:session): session closed for user root
Nov 05 14:57:40 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:40 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:40 devstack sudo[77077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 14:57:40 devstack sudo[77077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:57:40 devstack sudo[77077]: pam_unix(sudo:session): session closed for user root
Nov 05 14:57:40 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:40 devstack cinder-volume[76239]: DEBUG cinder.manager [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Notifying Schedulers of capabilities ... {{(pid=76239) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 14:57:40 devstack cinder-volume[76239]: INFO cinder.volume.manager [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Driver initialization completed successfully.
Nov 05 14:57:40 devstack cinder-volume[76239]: INFO cinder.manager [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Initiating service 2 cleanup
Nov 05 14:57:40 devstack cinder-volume[76239]: INFO cinder.manager [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Service 2 cleanup completed.
Nov 05 14:57:40 devstack cinder-volume[76239]: DEBUG cinder.service [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Creating RPC server for service cinder-volume {{(pid=76239) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 14:57:40 devstack cinder-volume[76239]: DEBUG cinder.service [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76239) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 14:57:40 devstack cinder-volume[76239]: INFO cinder.volume.manager [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Nov 05 14:57:40 devstack cinder-volume[76239]: DEBUG cinder.volume.drivers.lvm [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Updating volume stats {{(pid=76239) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 14:57:40 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:40 devstack sudo[77081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 14:57:40 devstack sudo[77081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:57:41 devstack sudo[77081]: pam_unix(sudo:session): session closed for user root
Nov 05 14:57:41 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:41 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:41 devstack sudo[77085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 14:57:41 devstack sudo[77085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:57:41 devstack sudo[77085]: pam_unix(sudo:session): session closed for user root
Nov 05 14:57:41 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:41 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:41 devstack sudo[77088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 14:57:41 devstack sudo[77088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:57:41 devstack sudo[77088]: pam_unix(sudo:session): session closed for user root
Nov 05 14:57:41 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:41 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:57:41 devstack sudo[77091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 14:57:41 devstack sudo[77091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:57:42 devstack sudo[77091]: pam_unix(sudo:session): session closed for user root
Nov 05 14:57:42 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:57:42 devstack cinder-volume[76239]: INFO cinder.volume.manager [None req-e948b081-4111-4d8b-af79-b59dedc2a2b4 None None] Driver post RPC initialization completed successfully.
Nov 05 14:57:44 devstack cinder-volume[76088]: DEBUG dbcounter [-] [76088] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76088) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 14:57:52 devstack cinder-volume[76239]: DEBUG dbcounter [-] [76239] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76239) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 14:57:52 devstack cinder-volume[76239]: DEBUG dbcounter [-] [76239] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76239) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 14:58:17 devstack cinder-volume[76239]: DEBUG oslo_service.periodic_task [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] Running periodic task VolumeManager._thread_info {{(pid=76239) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 14:58:17 devstack cinder-volume[76239]: DEBUG cinder.volume.manager [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] thread count: 6 {{(pid=76239) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 14:58:17 devstack cinder-volume[76239]: DEBUG cinder.volume.manager [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] thread info: [<_MainThread(MainThread, started 134109642727552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134109528168192)>, <Thread(Thread-3 (stat_writer), started daemon 134109529818880)>, <Thread(Rabbit-heartbeat, started daemon 134109527476480)>, <Thread(Thread-5 (_runner), started daemon 134109527527552)>, <Thread(Thread-7 (_runner), started daemon 134109527677184)>] {{(pid=76239) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 14:59:17 devstack cinder-volume[76239]: DEBUG oslo_service.periodic_task [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76239) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 14:59:17 devstack cinder-volume[76239]: DEBUG cinder.volume.drivers.lvm [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] Updating volume stats {{(pid=76239) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 14:59:17 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:59:17 devstack sudo[82200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 14:59:17 devstack sudo[82200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:59:17 devstack sudo[82200]: pam_unix(sudo:session): session closed for user root
Nov 05 14:59:17 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:59:17 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:59:17 devstack sudo[82203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 14:59:17 devstack sudo[82203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:59:17 devstack sudo[82203]: pam_unix(sudo:session): session closed for user root
Nov 05 14:59:17 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:59:17 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:59:17 devstack sudo[82208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 14:59:17 devstack sudo[82208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:59:17 devstack sudo[82208]: pam_unix(sudo:session): session closed for user root
Nov 05 14:59:17 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:59:17 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 14:59:17 devstack sudo[82211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 14:59:17 devstack sudo[82211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 14:59:18 devstack sudo[82211]: pam_unix(sudo:session): session closed for user root
Nov 05 14:59:18 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 14:59:18 devstack cinder-volume[76239]: DEBUG cinder.manager [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] Notifying Schedulers of capabilities ... {{(pid=76239) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 14:59:18 devstack cinder-volume[76239]: DEBUG oslo_service.periodic_task [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] Running periodic task VolumeManager._thread_info {{(pid=76239) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 14:59:18 devstack cinder-volume[76239]: DEBUG cinder.volume.manager [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] thread count: 6 {{(pid=76239) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 14:59:18 devstack cinder-volume[76239]: DEBUG cinder.volume.manager [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] thread info: [<_MainThread(MainThread, started 134109642727552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134109528168192)>, <Thread(Thread-3 (stat_writer), started daemon 134109529818880)>, <Thread(Rabbit-heartbeat, started daemon 134109527476480)>, <Thread(Thread-5 (_runner), started daemon 134109527527552)>, <Thread(Thread-7 (_runner), started daemon 134109527677184)>] {{(pid=76239) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 14:59:52 devstack cinder-volume[76239]: DEBUG dbcounter [-] [76239] Writing DB stats cinder:SELECT=1 {{(pid=76239) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 14:59:52 devstack cinder-volume[76239]: DEBUG dbcounter [-] [76239] Writing DB stats cinder:UPDATE=1 {{(pid=76239) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:00:17 devstack cinder-volume[76239]: DEBUG oslo_service.periodic_task [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76239) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:00:17 devstack cinder-volume[76239]: DEBUG cinder.volume.drivers.lvm [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] Updating volume stats {{(pid=76239) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 15:00:17 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:00:17 devstack sudo[83835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 15:00:17 devstack sudo[83835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:00:17 devstack sudo[83835]: pam_unix(sudo:session): session closed for user root
Nov 05 15:00:17 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:00:17 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:00:17 devstack sudo[83838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 15:00:17 devstack sudo[83838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:00:17 devstack sudo[83838]: pam_unix(sudo:session): session closed for user root
Nov 05 15:00:17 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:00:17 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:00:17 devstack sudo[83844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 15:00:17 devstack sudo[83844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:00:17 devstack sudo[83844]: pam_unix(sudo:session): session closed for user root
Nov 05 15:00:17 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:00:17 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:00:17 devstack sudo[83847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 15:00:17 devstack sudo[83847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:00:18 devstack sudo[83847]: pam_unix(sudo:session): session closed for user root
Nov 05 15:00:18 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:00:18 devstack cinder-volume[76239]: DEBUG cinder.manager [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] Notifying Schedulers of capabilities ... {{(pid=76239) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:01:17 devstack cinder-volume[76239]: DEBUG oslo_service.periodic_task [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76239) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:01:17 devstack cinder-volume[76239]: DEBUG cinder.volume.drivers.lvm [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] Updating volume stats {{(pid=76239) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 15:01:17 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:01:17 devstack sudo[85325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 15:01:17 devstack sudo[85325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:01:17 devstack sudo[85325]: pam_unix(sudo:session): session closed for user root
Nov 05 15:01:17 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:01:17 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:01:17 devstack sudo[85329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 15:01:17 devstack sudo[85329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:01:17 devstack sudo[85329]: pam_unix(sudo:session): session closed for user root
Nov 05 15:01:17 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:01:17 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:01:17 devstack sudo[85338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 15:01:17 devstack sudo[85338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:01:17 devstack sudo[85338]: pam_unix(sudo:session): session closed for user root
Nov 05 15:01:17 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:01:17 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:01:17 devstack sudo[85343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 15:01:17 devstack sudo[85343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:01:18 devstack sudo[85343]: pam_unix(sudo:session): session closed for user root
Nov 05 15:01:18 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:01:18 devstack cinder-volume[76239]: DEBUG cinder.manager [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] Notifying Schedulers of capabilities ... {{(pid=76239) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:01:18 devstack cinder-volume[76239]: DEBUG oslo_service.periodic_task [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] Running periodic task VolumeManager._thread_info {{(pid=76239) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:01:18 devstack cinder-volume[76239]: DEBUG cinder.volume.manager [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] thread count: 6 {{(pid=76239) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 15:01:18 devstack cinder-volume[76239]: DEBUG cinder.volume.manager [None req-1bd07d7a-0883-406e-b23c-f367131171d2 None None] thread info: [<_MainThread(MainThread, started 134109642727552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134109528168192)>, <Thread(Thread-3 (stat_writer), started daemon 134109529818880)>, <Thread(Rabbit-heartbeat, started daemon 134109527476480)>, <Thread(Thread-5 (_runner), started daemon 134109527527552)>, <Thread(Thread-7 (_runner), started daemon 134109527677184)>] {{(pid=76239) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 15:01:52 devstack cinder-volume[76239]: DEBUG dbcounter [-] [76239] Writing DB stats cinder:SELECT=1 {{(pid=76239) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:01:52 devstack cinder-volume[76239]: DEBUG dbcounter [-] [76239] Writing DB stats cinder:UPDATE=1 {{(pid=76239) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:02:02 devstack cinder-volume[76088]: INFO oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Caught SIGTERM, stopping children
Nov 05 15:02:02 devstack cinder-volume[76088]: DEBUG oslo_concurrency.lockutils [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Acquiring lock "singleton_lock" {{(pid=76088) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 15:02:02 devstack cinder-volume[76088]: DEBUG oslo_concurrency.lockutils [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Acquired lock "singleton_lock" {{(pid=76088) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 15:02:02 devstack cinder-volume[76088]: DEBUG oslo_concurrency.lockutils [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Releasing lock "singleton_lock" {{(pid=76088) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 15:02:02 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Stop services. {{(pid=76088) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 05 15:02:02 devstack cinder-volume[76088]: DEBUG oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Killing children. {{(pid=76088) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 05 15:02:02 devstack cinder-volume[76088]: INFO oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Waiting on 1 children to exit
Nov 05 15:02:05 devstack cinder-volume[76239]: DEBUG oslo_concurrency.lockutils [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Acquiring lock "singleton_lock" {{(pid=76239) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 15:02:05 devstack cinder-volume[76239]: DEBUG oslo_concurrency.lockutils [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Acquired lock "singleton_lock" {{(pid=76239) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 15:02:05 devstack cinder-volume[76239]: DEBUG oslo_concurrency.lockutils [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Releasing lock "singleton_lock" {{(pid=76239) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 15:02:05 devstack cinder-volume[76239]: WARNING amqp [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 15:02:05 devstack cinder-volume[76239]: WARNING amqp [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 15:02:05 devstack cinder-volume[76088]: INFO oslo_service.backend._eventlet.service [None req-13bc4edb-79e9-468e-b893-8a34799309db None None] Child 76239 exited with status 0
Nov 05 15:02:06 devstack cinder-volume[86273]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 15:02:06 devstack cinder-volume[86273]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 15:02:06 devstack cinder-volume[86273]: we strongly recommend against using it for new projects.
Nov 05 15:02:06 devstack cinder-volume[86273]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 15:02:06 devstack cinder-volume[86273]: framework.  For more detail see
Nov 05 15:02:06 devstack cinder-volume[86273]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 15:02:06 devstack cinder-volume[86273]:   import eventlet  # noqa
Nov 05 15:02:08 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86273) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 15:02:08 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86273) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 15:02:08 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86273) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 15:02:09 devstack cinder-volume[86273]: INFO dbcounter [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Registered counter for database cinder
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_db.sqlalchemy.engines [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86273) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG dbcounter [-] [86273] Writer thread running {{(pid=86273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 15:02:09 devstack cinder-volume[86273]: INFO cinder.rpc [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 15:02:09 devstack cinder-volume[86273]: INFO cinder.rpc [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_db.sqlalchemy.engines [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86273) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 15:02:09 devstack cinder-volume[86273]: INFO cinder.volume.manager [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Determined volume DB was empty at startup.
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG cinder.volume.manager [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86273) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 05 15:02:09 devstack cinder-volume[86273]: INFO cinder.volume.manager [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 05 15:02:09 devstack cinder-volume[86273]: WARNING stevedore.named [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 15:02:09 devstack cinder-volume[86273]: WARNING castellan.key_manager [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 15:02:09 devstack cinder-volume[86273]: WARNING cinder.keymgr.conf_key_mgr [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 15:02:09 devstack cinder-volume[86273]: INFO cinder.volume.manager [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_db.sqlalchemy.engines [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86273) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 15:02:09 devstack cinder-volume[86273]: INFO oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Starting 1 workers
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Started child 86526 {{(pid=86273) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Full set of CONF: {{(pid=86273) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] ******************************************************************************** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Configuration options gathered from: {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] ================================================================================ {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] allow_availability_zone_fallback = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] allow_compression_on_image_upload = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] allowed_direct_url_schemes     = [] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] api_rate_limit                 = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86526]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] auth_strategy                  = keystone {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_availability_zone      = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_host                   = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_name                   = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_stats_polling_interval = 60 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backup_api_class               = cinder.backup.api.API {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backup_name_template           = backup-%s {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backup_use_same_host           = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backup_use_temp_snapshot       = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] chap_password                  = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] chap_username                  =  {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cinder_internal_tenant_project_id = 38bbdcaf4f364f189e853f075f0ad47b {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cinder_internal_tenant_user_id = 0d20b209ecf04040a036e0c6fa2be821 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cluster                        = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] compression_format             = gzip {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] config_dir                     = [] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] config_source                  = [] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] control_exchange               = openstack {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] debug                          = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] default_availability_zone      = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] default_group_type             = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] default_volume_type            = QuobyteHD {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] disk_geometry                  = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] driver_client_cert             = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] driver_client_cert_key         = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] driver_data_namespace          = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] driver_ssl_cert_path           = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] driver_ssl_cert_verify         = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] driver_use_ssl                 = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] enable_new_services            = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] enable_unsupported_driver      = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] enforce_multipath_for_image_xfer = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] filter_function                = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] glance_api_insecure            = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] glance_api_servers             = ['http://192.168.122.140/image'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] glance_api_ssl_compression     = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] glance_ca_certificates_file    = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] glance_certfile                = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] glance_keyfile                 = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] glance_num_retries             = 3 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] glance_request_timeout         = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] goodness_function              = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] graceful_shutdown_timeout      = 5 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] group_api_class                = cinder.group.api.API {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] host                           = devstack {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] image_compress_on_upload       = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] image_conversion_address_space_limit = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] image_conversion_cpu_limit     = 60 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] image_conversion_disable       = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] image_introspection_address_space_limit = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] image_introspection_cpu_limit  = 60 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] image_upload_use_cinder_backend = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] image_upload_use_internal_tenant = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] image_volume_cache_enabled     = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] image_volume_cache_max_count   = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] image_volume_cache_max_size_gb = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] init_host_max_objects_retrieval = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] iscsi_target_flags             =  {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] iscsi_write_cache              = on {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] iser_helper                    = tgtadm {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] iser_ip_address                = 192.168.122.140 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] iser_port                      = 3260 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] log_color                      = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] log_config_append              = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] log_dir                        = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] log_file                       = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] log_options                    = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] log_rotate_interval            = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] log_rotate_interval_type       = days {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] log_rotation_type              = none {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] max_age                        = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] max_logfile_count              = 30 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] max_logfile_size_mb            = 200 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] max_over_subscription_ratio    = 20.0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] message_reap_interval          = 86400 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] message_ttl                    = 2592000 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] migration_create_volume_timeout_secs = 300 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] monkey_patch                   = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] monkey_patch_modules           = [] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] my_ip                          = 192.168.122.140 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] no_snapshot_gb_quota           = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] num_iser_scan_tries            = 3 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] num_shell_tries                = 3 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] num_volume_device_scan_tries   = 3 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] nvmeof_conn_info_version       = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 05 15:02:09 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86526) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] nvmet_ns_id                    = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] nvmet_port_id                  = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] osapi_max_limit                = 1000 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] osapi_volume_ext_list          = [] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] osapi_volume_listen_port       = 8776 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] osapi_volume_use_ssl           = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] osapi_volume_workers           = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] per_volume_size_limit          = -1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] periodic_fuzzy_delay           = 60 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] periodic_interval              = 60 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] public_endpoint                = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] publish_errors                 = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] quota_backup_gigabytes         = 1000 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] quota_backups                  = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] quota_gigabytes                = 1000 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] quota_groups                   = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] quota_snapshots                = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] quota_volumes                  = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] rate_limit_burst               = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] rate_limit_except_level        = CRITICAL {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] rate_limit_interval            = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] reinit_driver_count            = 3 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] replication_device             = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] report_discard_supported       = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] report_interval                = 120 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] reservation_clean_interval     = 86400 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] reservation_expire             = 86400 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] reserved_image_namespaces      = [] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] reserved_percentage            = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] rpc_response_timeout           = 120 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] run_external_periodic_tasks    = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] scst_target_driver             = iscsi {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] scst_target_iqn_name           = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] service_down_time              = 720 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] shell_completion               = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] snapshot_name_template         = snapshot-%s {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] split_loggers                  = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] state_path                     = /opt/stack/data/cinder {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] storage_availability_zone      = nova {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] storage_protocol               = iSCSI {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] syslog_log_facility            = LOG_USER {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] target_helper                  = lioadm {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] target_ip_address              = 192.168.122.140 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] target_port                    = 3260 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] target_protocol                = iscsi {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] target_secondary_ip_addresses  = [] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] trace_flags                    = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] transport_url                  = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] until_refresh                  = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] use_chap_auth                  = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] use_default_quota_class        = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] use_journal                    = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] use_json                       = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] use_multipath_for_image_xfer   = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] use_stderr                     = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] use_syslog                     = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] verify_glance_signatures       = enabled {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] volume_api_class               = cinder.volume.api.API {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] volume_backend_name            = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] volume_clear                   = zero {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] volume_clear_ionice            = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] volume_clear_size              = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] volume_copy_bps_limit          = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] volume_dd_blocksize            = 1M {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] volume_name_template           = volume-%s {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] volume_service_inithost_offload = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] volume_usage_audit_period      = month {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] zoning_mode                    = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_concurrency.disable_process_locking = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.auth_section = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.auth_type   = password {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.auth_version = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.cache       = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.certfile    = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.include_service_catalog = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.insecure    = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.interface   = public {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.keyfile     = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.memcache_password = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.memcache_username = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.region_name = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.service_type = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.140/identity {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.backend                  = dogpile.cache.null {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.backend_argument         = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.backend_expiration_time  = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.config_prefix            = cache.oslo {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.debug_cache_backend      = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.enable_retry_client      = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.enable_socket_keepalive  = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.enabled                  = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.expiration_time          = 600 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.hashclient_retry_attempts = 2 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.memcache_dead_retry      = 300 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.memcache_sasl_enabled    = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.password                 = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.proxies                  = [] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.redis_db                 = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.redis_server             = localhost:6379 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.retry_attempts           = 2 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86526) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 05 15:02:10 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.quobyte [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.retry_delay              = 0.0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.quobyte [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.socket_keepalive_count   = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.socket_keepalive_idle    = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.socket_keepalive_interval = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.socket_timeout           = 1.0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.tls_allowed_ciphers      = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Running cmd (subprocess): mount.quobyte {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.tls_cafile               = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.tls_certfile             = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.tls_enabled              = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.tls_keyfile              = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cache.username                 = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] coordination.backend_url       = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] database.asyncio_connection    = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] database.asyncio_slave_connection = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] database.backend               = sqlalchemy {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] database.connection            = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] database.connection_debug      = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] database.connection_parameters =  {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] database.connection_recycle_time = 3600 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] database.connection_trace      = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] database.db_inc_retry_interval = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] database.db_max_retries        = 20 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] database.db_max_retry_interval = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] database.db_retry_interval     = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] database.max_overflow          = 50 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] database.max_pool_size         = 5 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] database.max_retries           = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] database.mysql_wsrep_sync_wait = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] database.pool_timeout          = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] database.retry_interval        = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] database.slave_connection      = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] database.sqlite_synchronous    = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] database.synchronous_reader    = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] database.use_db_reconnect      = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_tracing.insecure = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] profiler.connection_string     = messaging:// {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] profiler.enabled               = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] profiler.es_doc_type           = notification {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] profiler.es_scroll_size        = 10000 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] profiler.es_scroll_time        = 2m {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] profiler.filter_error_trace    = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] profiler.hmac_keys             = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] profiler.sentinel_service_name = mymaster {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] profiler.socket_timeout        = 0.1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] profiler.trace_requests        = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] profiler.trace_sqlalchemy      = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] profiler_jaeger.process_tags   = {} {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] profiler_jaeger.service_name_prefix = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] profiler_otlp.service_name_prefix = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_policy.enforce_new_defaults = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_policy.policy_default_rule = default {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] privsep_osbrick.group          = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] privsep_osbrick.helper_command = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] privsep_osbrick.user           = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cinder_sys_admin.group         = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cinder_sys_admin.helper_command = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] cinder_sys_admin.user          = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] service_user.auth_section      = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] service_user.auth_type         = password {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] service_user.cafile            = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] service_user.certfile          = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] service_user.collect_timing    = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] service_user.insecure          = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] service_user.keyfile           = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] service_user.send_service_user_token = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] service_user.split_loggers     = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] service_user.timeout           = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] service_user.tls_ciphers       = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] service_user.tls_min_version   = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] glance.auth_section            = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] glance.auth_type               = password {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] glance.certfile                = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] glance.collect_timing          = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] glance.insecure                = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] glance.keyfile                 = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] glance.region_name             = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] glance.split_loggers           = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] glance.timeout                 = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] glance.tls_ciphers             = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] glance.tls_min_version         = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.backend_availability_zone = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.chap_password = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.chap_username =  {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.disk_geometry = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.driver_client_cert = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.driver_client_cert_key = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.driver_data_namespace = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.driver_use_ssl = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.extra_capabilities = {} {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.filter_function = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.goodness_function = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.iscsi_target_flags =  {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.iscsi_write_cache = on {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.iser_ip_address = 192.168.122.140 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.iser_port     = 3260 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.nas_host      =  {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.nas_login     = admin {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.nas_mount_options = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.nas_password  = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.nas_private_key =  {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.nas_share_path =  {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.num_shell_tries = 3 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.quobyte_volume_url = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.replication_device = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.report_discard_supported = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.reserved_percentage = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.target_helper = tgtadm {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.target_ip_address = 192.168.122.140 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.target_port   = 3260 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.target_protocol = iscsi {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.trace_flags   = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.unique_fqdn_network = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.use_chap_auth = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.volume_backend_name = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.volume_clear  = zero {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.volume_clear_ionice = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.volume_clear_size = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_reports.file_event_handler = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_reports.log_dir           = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.backend_availability_zone = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.backend_host         = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.chap_password        = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.chap_username        = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.disk_geometry        = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.driver_client_cert   = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.driver_data_namespace = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.extra_capabilities   = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.filter_function      = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.goodness_function    = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.iser_helper          = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.iser_ip_address      = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.iser_port            = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.nas_host             = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.nas_login            = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.nas_mount_options    = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.nas_password         = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.nas_private_key      = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.nas_share_path       = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] CMD "mount.quobyte" returned: 1 in 0.113s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:02:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.num_shell_tries      = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86526]: INFO cinder.volume.drivers.quobyte [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 ...
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d -c /etc/quobyte/client-cinder.cfg {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.replication_device   = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.report_discard_supported = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.reserved_percentage  = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.scst_target_driver   = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.storage_protocol     = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.target_helper        = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.target_ip_address    = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.target_port          = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.target_prefix        = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.target_protocol      = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.trace_flags          = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.use_chap_auth        = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.volume_clear         = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.volume_clear_size    = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] QuobyteHD.volumes_dir          = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_notifications.driver = [] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_notifications.retry = -1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack sudo[86532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d -c /etc/quobyte/client-cinder.cfg
Nov 05 15:02:10 devstack sudo[86532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] key_manager.fixed_key          = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican.barbican_api_version  = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican.barbican_endpoint     = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican.barbican_endpoint_type = public {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican.barbican_region_name  = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican.cafile                = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican.certfile              = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican.collect_timing        = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican.insecure              = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican.keyfile               = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican.number_of_retries     = 60 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican.retry_delay           = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican.send_service_user_token = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican.split_loggers         = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican.timeout               = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican.tls_ciphers           = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican.tls_min_version       = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican.verify_ssl            = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican.verify_ssl_path       = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican_service_user.auth_section = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican_service_user.auth_type = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican_service_user.cafile   = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican_service_user.certfile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican_service_user.collect_timing = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican_service_user.insecure = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican_service_user.keyfile  = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican_service_user.split_loggers = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican_service_user.timeout  = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican_service_user.tls_ciphers = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] barbican_service_user.tls_min_version = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] vault.approle_role_id          = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] vault.approle_secret_id        = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] vault.auth_method              = approle {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] vault.auth_path                = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] vault.kv_mountpoint            = secret {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] vault.kv_path                  = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] vault.kv_version               = 2 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] vault.namespace                = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] vault.root_token_id            = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] vault.ssl_ca_crt_file          = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] vault.timeout                  = 60.0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] vault.token_file               = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] vault.token_role               = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] vault.use_ssl                  = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:10 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] ******************************************************************************** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 15:02:10 devstack sudo[86532]: pam_unix(sudo:session): session closed for user root
Nov 05 15:02:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.432s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:02:10 devstack cinder-volume[86526]: INFO cinder.volume.drivers.quobyte [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 succeeded
Nov 05 15:02:10 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:02:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.450s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:02:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:02:10 devstack sudo[86634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:02:10 devstack sudo[86634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:02:10 devstack sudo[86634]: pam_unix(sudo:session): session closed for user root
Nov 05 15:02:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.246s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:02:10 devstack cinder-volume[86526]: INFO cinder.volume.driver [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 15:02:10 devstack cinder-volume[86526]: DEBUG cinder.volume.driver [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4655227661133, 'free_capacity_gb': 1773.4655227661133, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86526) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 15:02:10 devstack cinder-volume[86526]: DEBUG oslo_db.sqlalchemy.engines [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86526) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 15:02:11 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writer thread running {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 15:02:11 devstack cinder-volume[86526]: DEBUG cinder.db.api [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Building query based on filter {{(pid=86526) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 05 15:02:11 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86526) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 05 15:02:11 devstack cinder-volume[86526]: INFO cinder.keymgr.migration [None req-2072860c-80ce-41b1-b4bd-c9364fa8ab81 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 15:02:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:02:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:02:11 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:02:11 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:02:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:02:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:02:11 devstack sudo[86637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:02:11 devstack sudo[86637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:02:11 devstack sudo[86637]: pam_unix(sudo:session): session closed for user root
Nov 05 15:02:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.228s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:02:11 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:02:11 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Driver initialization completed successfully.
Nov 05 15:02:11 devstack cinder-volume[86526]: INFO cinder.manager [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Initiating service 3 cleanup
Nov 05 15:02:11 devstack cinder-volume[86526]: INFO cinder.manager [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Service 3 cleanup completed.
Nov 05 15:02:11 devstack cinder-volume[86526]: DEBUG cinder.service [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Creating RPC server for service cinder-volume {{(pid=86526) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 15:02:11 devstack cinder-volume[86526]: DEBUG cinder.service [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86526) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 15:02:11 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 05 15:02:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:02:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:02:11 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:02:11 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:02:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:02:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:02:11 devstack sudo[86640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:02:11 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:02:11 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root
Nov 05 15:02:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.265s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:02:11 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-2003d114-bc09-4a74-92ac-c9d5fd22d3ef None None] Driver post RPC initialization completed successfully.
Nov 05 15:02:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fca1ad56-8786-4b01-9bce-0adf318a579e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:02:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fca1ad56-8786-4b01-9bce-0adf318a579e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:02:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fca1ad56-8786-4b01-9bce-0adf318a579e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:02:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fca1ad56-8786-4b01-9bce-0adf318a579e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:02:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fca1ad56-8786-4b01-9bce-0adf318a579e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:02:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fca1ad56-8786-4b01-9bce-0adf318a579e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:02:16 devstack sudo[86829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:02:16 devstack sudo[86829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:02:16 devstack cinder-volume[86273]: INFO oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Caught SIGTERM, stopping children
Nov 05 15:02:16 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Acquiring lock "singleton_lock" {{(pid=86273) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 15:02:16 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Acquired lock "singleton_lock" {{(pid=86273) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 15:02:16 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Releasing lock "singleton_lock" {{(pid=86273) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 15:02:16 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Stop services. {{(pid=86273) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 05 15:02:16 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Killing children. {{(pid=86273) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 05 15:02:16 devstack cinder-volume[86273]: INFO oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Waiting on 1 children to exit
Nov 05 15:02:16 devstack sudo[86829]: pam_unix(sudo:session): session closed for user root
Nov 05 15:02:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fca1ad56-8786-4b01-9bce-0adf318a579e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.417s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:02:16 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-fca1ad56-8786-4b01-9bce-0adf318a579e None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fca1ad56-8786-4b01-9bce-0adf318a579e None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fca1ad56-8786-4b01-9bce-0adf318a579e None None] Unable to connect to AMQP server on 192.168.122.140:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server [None req-fca1ad56-8786-4b01-9bce-0adf318a579e None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.140:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     ret, channel = autoretry_method()
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server                    ^^^^^^^^^^^^^^^^^^
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     return fun(*args, **kwargs)
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     return fun(*args, channel=channels[0], **kwargs), channels[0]
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     method()
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1575, in _publish
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     self._producer.publish(
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     return _publish(
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     return channel.basic_publish(
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     self.wait([spec.Basic.Ack, spec.Basic.Nack],
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     self.connection.drain_events(timeout=timeout)
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     while not self.blocking_read(timeout):
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server               ^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     return self.on_inbound_frame(frame)
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     callback(channel, method_sig, buf, None)
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     return self.channels[channel_id].dispatch_method(
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     listener(*args)
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     raise error_for_code(
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server 
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server 
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     self._publish_service_capabilities(context)
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     self.scheduler_rpcapi.update_service_capabilities(
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     cctxt.cast(ctxt, 'update_service_capabilities', **msg_args)
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     self.transport._send(
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 824, in send
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 799, in _send
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     conn.fanout_send(target.topic, msg, retry=retry)
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1694, in fanout_send
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     self._ensure_publishing(self._publish, exchange, msg, retry=retry)
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1524, in _ensure_publishing
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     self.ensure(method, retry=retry, error_callback=_error_callback)
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1135, in ensure
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server     raise exceptions.MessageDeliveryFailure(msg)
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.140:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 05 15:02:16 devstack cinder-volume[86526]: ERROR oslo_messaging.rpc.server 
Nov 05 15:02:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Acquiring lock "singleton_lock" {{(pid=86526) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 15:02:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Acquired lock "singleton_lock" {{(pid=86526) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 15:02:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Releasing lock "singleton_lock" {{(pid=86526) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 15:02:19 devstack cinder-volume[86526]: WARNING amqp [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 15:02:19 devstack cinder-volume[86526]: WARNING amqp [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 15:02:19 devstack cinder-volume[86273]: INFO oslo_service.backend._eventlet.service [None req-b0c84c21-4d7e-4366-a862-a7e567a0dd23 None None] Child 86526 exited with status 0
Nov 05 15:02:20 devstack cinder-volume[86852]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 15:02:20 devstack cinder-volume[86852]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 15:02:20 devstack cinder-volume[86852]: we strongly recommend against using it for new projects.
Nov 05 15:02:20 devstack cinder-volume[86852]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 15:02:20 devstack cinder-volume[86852]: framework.  For more detail see
Nov 05 15:02:20 devstack cinder-volume[86852]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 15:02:20 devstack cinder-volume[86852]:   import eventlet  # noqa
Nov 05 15:02:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86852) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 15:02:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86852) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 15:02:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86852) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 15:02:24 devstack cinder-volume[86852]: INFO dbcounter [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] Registered counter for database cinder
Nov 05 15:02:24 devstack cinder-volume[86852]: DEBUG oslo_db.sqlalchemy.engines [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86852) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 15:02:24 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writer thread running {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 15:02:24 devstack cinder-volume[86852]: INFO cinder.rpc [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 15:02:24 devstack cinder-volume[86852]: INFO cinder.rpc [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 15:02:24 devstack cinder-volume[86852]: DEBUG oslo_db.sqlalchemy.engines [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86852) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 15:02:24 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] Determined volume DB was empty at startup.
Nov 05 15:02:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86852) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 05 15:02:24 devstack cinder-volume[86852]: WARNING stevedore.named [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 15:02:24 devstack cinder-volume[86852]: WARNING castellan.key_manager [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 15:02:24 devstack cinder-volume[86852]: WARNING cinder.keymgr.conf_key_mgr [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 15:02:24 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_db.sqlalchemy.engines [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86852) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 15:02:25 devstack cinder-volume[86852]: INFO oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] Starting 1 workers
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] Started child 87150 {{(pid=86852) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] Full set of CONF: {{(pid=86852) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] ******************************************************************************** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] Configuration options gathered from: {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] ================================================================================ {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] allow_availability_zone_fallback = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] allow_compression_on_image_upload = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] allowed_direct_url_schemes     = [] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] api_rate_limit                 = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] auth_strategy                  = keystone {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_availability_zone      = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_host                   = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_name                   = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_stats_polling_interval = 60 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backup_api_class               = cinder.backup.api.API {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backup_name_template           = backup-%s {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backup_use_same_host           = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[87150]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backup_use_temp_snapshot       = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] chap_password                  = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] chap_username                  =  {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cinder_internal_tenant_project_id = 38bbdcaf4f364f189e853f075f0ad47b {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cinder_internal_tenant_user_id = 0d20b209ecf04040a036e0c6fa2be821 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cluster                        = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] compression_format             = gzip {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] compute_api_class              = cinder.compute.nova.API {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] config_dir                     = [] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] config_source                  = [] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] control_exchange               = openstack {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] debug                          = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] default_availability_zone      = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] default_group_type             = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] default_volume_type            = QuobyteHD {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] disk_geometry                  = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] driver_client_cert             = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] driver_client_cert_key         = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] driver_data_namespace          = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] driver_ssl_cert_path           = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] driver_ssl_cert_verify         = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] driver_use_ssl                 = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] enable_new_services            = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] enable_unsupported_driver      = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] enabled_backends               = ['QuobyteHD'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] enforce_multipath_for_image_xfer = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] filter_function                = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] glance_api_insecure            = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] glance_api_servers             = ['http://192.168.122.140/image'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] glance_api_ssl_compression     = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] glance_ca_certificates_file    = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] glance_catalog_info            = image:glance:publicURL {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] glance_certfile                = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] glance_keyfile                 = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] glance_num_retries             = 3 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] glance_request_timeout         = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] goodness_function              = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] graceful_shutdown_timeout      = 5 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] group_api_class                = cinder.group.api.API {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] host                           = devstack {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] image_compress_on_upload       = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] image_conversion_address_space_limit = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] image_conversion_cpu_limit     = 60 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] image_conversion_disable       = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] image_introspection_address_space_limit = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] image_introspection_cpu_limit  = 60 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] image_upload_use_cinder_backend = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] image_upload_use_internal_tenant = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] image_volume_cache_enabled     = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] image_volume_cache_max_count   = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] image_volume_cache_max_size_gb = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] init_host_max_objects_retrieval = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] instance_format                = [instance: %(uuid)s]  {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] iscsi_target_flags             =  {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] iscsi_write_cache              = on {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] iser_helper                    = tgtadm {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] iser_ip_address                = 192.168.122.140 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] iser_port                      = 3260 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] log_color                      = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] log_config_append              = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] log_dir                        = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] log_file                       = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] log_options                    = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] log_rotate_interval            = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] log_rotate_interval_type       = days {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] log_rotation_type              = none {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] max_age                        = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] max_logfile_count              = 30 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] max_logfile_size_mb            = 200 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] max_over_subscription_ratio    = 20.0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] message_reap_interval          = 86400 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] message_ttl                    = 2592000 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] migration_create_volume_timeout_secs = 300 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] monkey_patch                   = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] monkey_patch_modules           = [] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] my_ip                          = 192.168.122.140 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] no_snapshot_gb_quota           = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] num_iser_scan_tries            = 3 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] num_shell_tries                = 3 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] num_volume_device_scan_tries   = 3 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] nvmeof_conn_info_version       = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] nvmet_ns_id                    = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] nvmet_port_id                  = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] osapi_max_limit                = 1000 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] osapi_volume_ext_list          = [] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] osapi_volume_listen_port       = 8776 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] osapi_volume_use_ssl           = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] osapi_volume_workers           = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] per_volume_size_limit          = -1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] periodic_fuzzy_delay           = 60 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] periodic_interval              = 60 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] public_endpoint                = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] publish_errors                 = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] quota_backup_gigabytes         = 1000 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] quota_backups                  = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] quota_gigabytes                = 1000 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] quota_groups                   = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] quota_snapshots                = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] quota_volumes                  = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] rate_limit_burst               = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] rate_limit_except_level        = CRITICAL {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] rate_limit_interval            = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] reinit_driver_count            = 3 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] replication_device             = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] report_discard_supported       = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] report_interval                = 120 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] reservation_clean_interval     = 86400 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] reservation_expire             = 86400 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] reserved_image_namespaces      = [] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] reserved_percentage            = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] rpc_response_timeout           = 120 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] run_external_periodic_tasks    = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] scst_target_driver             = iscsi {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] scst_target_iqn_name           = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] service_down_time              = 720 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] shell_completion               = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] snapshot_name_template         = snapshot-%s {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] split_loggers                  = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] state_path                     = /opt/stack/data/cinder {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] storage_availability_zone      = nova {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] storage_protocol               = iSCSI {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] syslog_log_facility            = LOG_USER {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] target_helper                  = lioadm {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] target_ip_address              = 192.168.122.140 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] target_port                    = 3260 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] target_protocol                = iscsi {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] target_secondary_ip_addresses  = [] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] trace_flags                    = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87150) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] transport_url                  = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] until_refresh                  = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] use_chap_auth                  = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] use_default_quota_class        = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] use_journal                    = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] use_json                       = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] use_multipath_for_image_xfer   = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] use_stderr                     = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] use_syslog                     = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] verify_glance_signatures       = enabled {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] volume_api_class               = cinder.volume.api.API {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] volume_backend_name            = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] volume_clear                   = zero {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] volume_clear_ionice            = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] volume_clear_size              = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] volume_copy_bps_limit          = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] volume_dd_blocksize            = 1M {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] volume_name_template           = volume-%s {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] volume_service_inithost_offload = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] volume_usage_audit_period      = month {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] zoning_mode                    = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_concurrency.disable_process_locking = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.auth_section = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.auth_type   = password {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.auth_version = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.cache       = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.certfile    = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.delay_auth_decision = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.http_connect_timeout = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.include_service_catalog = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.insecure    = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.interface   = public {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.keyfile     = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.memcache_password = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87150) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 05 15:02:25 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.quobyte [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 05 15:02:25 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.quobyte [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.memcache_username = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.region_name = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.service_token_roles_required = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Running cmd (subprocess): mount.quobyte {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.service_type = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.token_cache_time = 300 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.140/identity {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.backend                  = dogpile.cache.null {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.backend_argument         = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.backend_expiration_time  = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.config_prefix            = cache.oslo {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.debug_cache_backend      = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.enable_retry_client      = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.enable_socket_keepalive  = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.enabled                  = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.expiration_time          = 600 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.hashclient_retry_attempts = 2 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.memcache_dead_retry      = 300 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.memcache_pool_maxsize    = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.memcache_sasl_enabled    = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.password                 = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.proxies                  = [] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.redis_db                 = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.redis_sentinel_service_name = mymaster {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.redis_server             = localhost:6379 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.retry_attempts           = 2 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.retry_delay              = 0.0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.socket_keepalive_count   = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.socket_keepalive_idle    = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.socket_keepalive_interval = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.socket_timeout           = 1.0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.tls_allowed_ciphers      = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.tls_cafile               = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.tls_certfile             = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.tls_enabled              = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.tls_keyfile              = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cache.username                 = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] coordination.backend_url       = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] database.asyncio_connection    = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] database.asyncio_slave_connection = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] database.backend               = sqlalchemy {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] database.connection            = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] database.connection_debug      = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] database.connection_parameters =  {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] database.connection_recycle_time = 3600 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] database.connection_trace      = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] database.db_inc_retry_interval = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] database.db_max_retries        = 20 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] database.db_max_retry_interval = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] database.db_retry_interval     = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] database.max_overflow          = 50 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] database.max_pool_size         = 5 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] database.max_retries           = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] database.mysql_wsrep_sync_wait = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] database.pool_timeout          = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] database.retry_interval        = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] database.slave_connection      = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] database.sqlite_synchronous    = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] database.synchronous_reader    = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] database.use_db_reconnect      = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_tracing.insecure = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] profiler.connection_string     = messaging:// {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] profiler.enabled               = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] profiler.es_doc_type           = notification {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] profiler.es_scroll_size        = 10000 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack quobyte-client[87153]: Reading configuration file: /etc/quobyte/client.cfg
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] profiler.es_scroll_time        = 2m {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] profiler.filter_error_trace    = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] profiler.hmac_keys             = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] profiler.sentinel_service_name = mymaster {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] profiler.socket_timeout        = 0.1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] profiler.trace_requests        = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] profiler.trace_sqlalchemy      = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack quobyte-client[87153]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] CMD "mount.quobyte" returned: 1 in 0.058s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] profiler_jaeger.process_tags   = {} {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] profiler_jaeger.service_name_prefix = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] profiler_otlp.service_name_prefix = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_policy.enforce_new_defaults = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_policy.policy_default_rule = default {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_policy.policy_file        = policy.yaml {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] privsep_osbrick.group          = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] privsep_osbrick.helper_command = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] privsep_osbrick.user           = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cinder_sys_admin.group         = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cinder_sys_admin.helper_command = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] cinder_sys_admin.user          = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] service_user.auth_section      = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] service_user.auth_type         = password {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] service_user.cafile            = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] service_user.certfile          = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] service_user.collect_timing    = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] service_user.insecure          = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] service_user.keyfile           = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] service_user.send_service_user_token = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] service_user.split_loggers     = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] service_user.timeout           = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] service_user.tls_ciphers       = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] service_user.tls_min_version   = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] glance.auth_section            = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] glance.auth_type               = password {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] glance.certfile                = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] glance.collect_timing          = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] glance.insecure                = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] glance.keyfile                 = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] glance.region_name             = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] glance.split_loggers           = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] glance.timeout                 = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] glance.tls_ciphers             = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] glance.tls_min_version         = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.backend_availability_zone = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.chap_password = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.chap_username =  {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.disk_geometry = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.driver_client_cert = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.driver_client_cert_key = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.driver_data_namespace = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.driver_use_ssl = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack sudo[87160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.enable_unsupported_driver = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.extra_capabilities = {} {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.filter_function = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.goodness_function = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.iscsi_target_flags =  {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.iscsi_write_cache = on {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.iser_helper   = tgtadm {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.iser_ip_address = 192.168.122.140 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.iser_port     = 3260 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.nas_host      =  {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.nas_login     = admin {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.nas_mount_options = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.nas_password  = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.nas_private_key =  {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.nas_share_path =  {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.num_shell_tries = 3 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.nvmet_port_id = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.quobyte_client_cfg = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.quobyte_volume_url = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.replication_device = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.report_discard_supported = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.reserved_percentage = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.scst_target_driver = iscsi {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.scst_target_iqn_name = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.storage_protocol = iSCSI {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.target_helper = tgtadm {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.target_ip_address = 192.168.122.140 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.target_port   = 3260 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.target_protocol = iscsi {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.trace_flags   = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.unique_fqdn_network = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.use_chap_auth = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.volume_backend_name = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.volume_clear  = zero {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.volume_clear_ionice = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.volume_clear_size = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_reports.file_event_handler = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_reports.log_dir           = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.backend_availability_zone = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.backend_host         = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.chap_password        = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.chap_username        = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.chiscsi_conf         = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.disk_geometry        = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.driver_client_cert   = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.driver_client_cert_key = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.driver_data_namespace = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.driver_use_ssl       = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.extra_capabilities   = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.filter_function      = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.goodness_function    = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.iser_helper          = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.iser_ip_address      = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.iser_port            = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.iser_target_prefix   = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.nas_host             = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.nas_login            = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.nas_mount_options    = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.nas_password         = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.nas_private_key      = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.nas_share_path       = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.nas_ssh_port         = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.num_shell_tries      = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.nvmet_port_id        = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.replication_device   = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.report_discard_supported = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.reserved_percentage  = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.scst_target_driver   = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.storage_protocol     = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.target_helper        = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.target_ip_address    = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.target_port          = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.target_prefix        = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.target_protocol      = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.trace_flags          = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.use_chap_auth        = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.volume_clear         = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.volume_clear_size    = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] QuobyteHD.volumes_dir          = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.ssl      = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_notifications.driver = [] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_notifications.retry = -1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] oslo_messaging_notifications.transport_url = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] key_manager.fixed_key          = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican.barbican_api_version  = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican.barbican_endpoint     = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican.barbican_endpoint_type = public {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican.barbican_region_name  = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican.cafile                = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican.certfile              = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican.collect_timing        = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican.insecure              = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican.keyfile               = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican.number_of_retries     = 60 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican.retry_delay           = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican.send_service_user_token = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican.split_loggers         = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican.timeout               = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican.tls_ciphers           = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican.tls_min_version       = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican.verify_ssl            = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican.verify_ssl_path       = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican_service_user.auth_section = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican_service_user.auth_type = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican_service_user.cafile   = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican_service_user.certfile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican_service_user.collect_timing = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican_service_user.insecure = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican_service_user.keyfile  = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican_service_user.split_loggers = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican_service_user.timeout  = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican_service_user.tls_ciphers = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] barbican_service_user.tls_min_version = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] vault.approle_role_id          = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] vault.approle_secret_id        = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] vault.auth_method              = approle {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] vault.auth_path                = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] vault.kv_mountpoint            = secret {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] vault.kv_path                  = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] vault.kv_version               = 2 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] vault.namespace                = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] vault.root_token_id            = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] vault.ssl_ca_crt_file          = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] vault.timeout                  = 60.0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] vault.token_file               = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] vault.token_role               = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] vault.use_ssl                  = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 15:02:25 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-55a4f28f-cf39-4a0e-9622-f1d928dd2c6a None None] ******************************************************************************** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 15:02:25 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.270s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:02:25 devstack cinder-volume[87150]: INFO cinder.volume.driver [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG cinder.volume.driver [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4655227661133, 'free_capacity_gb': 1773.4655227661133, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87150) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG oslo_db.sqlalchemy.engines [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87150) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writer thread running {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG cinder.db.api [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Building query based on filter {{(pid=87150) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87150) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:02:25 devstack cinder-volume[87150]: INFO cinder.keymgr.migration [None req-501d97cb-8e4e-44e4-96fe-7fb671687024 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 15:02:25 devstack sudo[87172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:02:25 devstack sudo[87172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:02:25 devstack sudo[87172]: pam_unix(sudo:session): session closed for user root
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.234s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:02:25 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Driver initialization completed successfully.
Nov 05 15:02:25 devstack cinder-volume[87150]: INFO cinder.manager [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Initiating service 3 cleanup
Nov 05 15:02:25 devstack cinder-volume[87150]: INFO cinder.manager [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Service 3 cleanup completed.
Nov 05 15:02:25 devstack cinder-volume[87150]: DEBUG cinder.service [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Creating RPC server for service cinder-volume {{(pid=87150) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 15:02:26 devstack cinder-volume[87150]: DEBUG cinder.service [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87150) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 15:02:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 05 15:02:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:02:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:02:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:02:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:02:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:02:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:02:26 devstack sudo[87185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:02:26 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:02:26 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root
Nov 05 15:02:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.247s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:02:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0b2b49d2-a4fe-49a4-b2af-5f0fa14c86ce None None] Driver post RPC initialization completed successfully.
Nov 05 15:02:35 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:02:36 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:02:36 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=3 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:02:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:02:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread count: 6 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 15:02:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread info: [<_MainThread(MainThread, started 136317437956224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136317326340928)>, <Thread(Thread-3 (stat_writer), started daemon 136317326487936)>, <Thread(Rabbit-heartbeat, started daemon 136317321464000)>, <Thread(Thread-5 (_runner), started daemon 136317321550592)>, <Thread(Thread-7 (_runner), started daemon 136317321658496)>] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 15:03:23 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:03:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Flow 'volume_create_manager' (aff17e15-b164-47ae-9542-5a4e85ddf903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:03:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956dde99-6fc3-4be6-917a-d2215b04f46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:03:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956dde99-6fc3-4be6-917a-d2215b04f46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-962674630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73e598e-86de-48ad-82b4-f96b41364028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab576562599942b1bc62dc0e1e14c7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:03:24Z,use_quota=True,user_id='b8984bbdb37b40f8a681476695503b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:03:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ca6416-06bc-407b-bbf6-4929d5caaf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:03:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ca6416-06bc-407b-bbf6-4929d5caaf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:03:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (749b06a2-232d-4da2-a7df-476305e133ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:03:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (749b06a2-232d-4da2-a7df-476305e133ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c73e598e-86de-48ad-82b4-f96b41364028', 'volume_name': 'volume-c73e598e-86de-48ad-82b4-f96b41364028', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:03:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed25e98-49f5-4bcd-98b1-e39ccb709a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:03:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed25e98-49f5-4bcd-98b1-e39ccb709a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:03:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11bdb618-52be-4986-9fae-7b7f74d612e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:03:23 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Volume c73e598e-86de-48ad-82b4-f96b41364028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c73e598e-86de-48ad-82b4-f96b41364028', 'volume_size': 1}
Nov 05 15:03:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:03:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:03:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-962674630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73e598e-86de-48ad-82b4-f96b41364028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab576562599942b1bc62dc0e1e14c7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:03:24Z,use_quota=True,user_id='b8984bbdb37b40f8a681476695503b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:03:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Creating volume c73e598e-86de-48ad-82b4-f96b41364028 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:03:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:03:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:03:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:03:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:03:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:03:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:03:23 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:03:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c73e598e-86de-48ad-82b4-f96b41364028 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:03:23 devstack sudo[87545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c73e598e-86de-48ad-82b4-f96b41364028 1073741824
Nov 05 15:03:23 devstack sudo[87545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:03:24 devstack sudo[87545]: pam_unix(sudo:session): session closed for user root
Nov 05 15:03:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c73e598e-86de-48ad-82b4-f96b41364028 1073741824" returned: 0 in 0.625s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:03:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c73e598e-86de-48ad-82b4-f96b41364028 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:03:24 devstack sudo[87865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c73e598e-86de-48ad-82b4-f96b41364028
Nov 05 15:03:24 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:03:24 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root
Nov 05 15:03:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c73e598e-86de-48ad-82b4-f96b41364028" returned: 0 in 0.309s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:03:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:03:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:03:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11bdb618-52be-4986-9fae-7b7f74d612e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c73e598e-86de-48ad-82b4-f96b41364028', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:03:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f454a546-746b-43af-92d1-fcc214064127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:03:24 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Volume volume-c73e598e-86de-48ad-82b4-f96b41364028 (c73e598e-86de-48ad-82b4-f96b41364028): created successfully
Nov 05 15:03:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f454a546-746b-43af-92d1-fcc214064127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:03:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Flow 'volume_create_manager' (aff17e15-b164-47ae-9542-5a4e85ddf903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:03:24 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-afd6a88e-0843-4ed7-95c6-1e3134718711 tempest-TaggedAttachmentsTest-293454082 None] Created volume successfully.
Nov 05 15:03:34 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:03:34 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:03:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:03:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:03:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:03:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:03:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:03:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:03:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:03:37 devstack sudo[88011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:03:37 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:03:37 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root
Nov 05 15:03:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.590s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:03:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:03:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:03:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread count: 6 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 15:03:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread info: [<_MainThread(MainThread, started 136317437956224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136317326340928)>, <Thread(Thread-3 (stat_writer), started daemon 136317326487936)>, <Thread(Rabbit-heartbeat, started daemon 136317321464000)>, <Thread(Thread-5 (_runner), started daemon 136317321550592)>, <Thread(Thread-7 (_runner), started daemon 136317321658496)>] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 15:03:56 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:03:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Flow 'volume_create_manager' (ae1f52c8-fd79-4cb7-b74a-e9e0cf403acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:03:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee9c04f-59e4-4614-8385-234eb3a03d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:03:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee9c04f-59e4-4614-8385-234eb3a03d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2033807803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a1f387-4202-4739-858e-b588f87ea62c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b04e992f72045d79c95b9a455b14818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:03:56Z,use_quota=True,user_id='6a7f040ab9e34fd0980d95876e85b1bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:03:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288db293-dac9-4d89-9d28-91625f6a5bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:03:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288db293-dac9-4d89-9d28-91625f6a5bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:03:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d01c58d4-57a3-4dba-958f-a2cd9dc456a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:03:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d01c58d4-57a3-4dba-958f-a2cd9dc456a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40a1f387-4202-4739-858e-b588f87ea62c', 'volume_name': 'volume-40a1f387-4202-4739-858e-b588f87ea62c', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:03:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (072ab0f8-4710-42ef-978e-e7350287b61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:03:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (072ab0f8-4710-42ef-978e-e7350287b61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:03:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97936b05-96ca-4e6e-afc2-dc3d85a4f13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:03:56 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Volume 40a1f387-4202-4739-858e-b588f87ea62c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40a1f387-4202-4739-858e-b588f87ea62c', 'volume_size': 1}
Nov 05 15:03:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:03:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:03:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2033807803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a1f387-4202-4739-858e-b588f87ea62c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b04e992f72045d79c95b9a455b14818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:03:56Z,use_quota=True,user_id='6a7f040ab9e34fd0980d95876e85b1bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:03:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Creating volume 40a1f387-4202-4739-858e-b588f87ea62c {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:03:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:03:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:03:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:03:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:03:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:03:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:03:56 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:03:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-40a1f387-4202-4739-858e-b588f87ea62c 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:03:56 devstack sudo[88345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-40a1f387-4202-4739-858e-b588f87ea62c 1073741824
Nov 05 15:03:56 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:03:57 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root
Nov 05 15:03:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-40a1f387-4202-4739-858e-b588f87ea62c 1073741824" returned: 0 in 1.166s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:03:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-40a1f387-4202-4739-858e-b588f87ea62c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:03:58 devstack sudo[88366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-40a1f387-4202-4739-858e-b588f87ea62c
Nov 05 15:03:58 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:03:58 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root
Nov 05 15:03:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-40a1f387-4202-4739-858e-b588f87ea62c" returned: 0 in 0.692s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:03:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] <== create_volume: return (1978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:03:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:03:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97936b05-96ca-4e6e-afc2-dc3d85a4f13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40a1f387-4202-4739-858e-b588f87ea62c', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:03:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87badba3-d9e3-429b-82fb-b9624cd33acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:03:58 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Volume volume-40a1f387-4202-4739-858e-b588f87ea62c (40a1f387-4202-4739-858e-b588f87ea62c): created successfully
Nov 05 15:03:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87badba3-d9e3-429b-82fb-b9624cd33acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:03:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Flow 'volume_create_manager' (ae1f52c8-fd79-4cb7-b74a-e9e0cf403acb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:03:58 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-be879931-a1b4-4b53-9235-2467e15819d5 tempest-VolumesAdminNegativeTest-1039202547 None] Created volume successfully.
Nov 05 15:04:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] Acquiring lock "cinder-40a1f387-4202-4739-858e-b588f87ea62c-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:04:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] Lock "cinder-40a1f387-4202-4739-858e-b588f87ea62c-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:04:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] Acquiring lock "cinder-quobyte-40a1f387-4202-4739-858e-b588f87ea62c" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:04:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] Lock "cinder-quobyte-40a1f387-4202-4739-858e-b588f87ea62c" acquired by "delete_volume" :: waited 0.036s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:04:00 devstack cinder-volume[87150]: INFO oslo.privsep.daemon [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_m921dvy/privsep.sock']
Nov 05 15:04:00 devstack sudo[88374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_m921dvy/privsep.sock
Nov 05 15:04:00 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:04:02 devstack cinder-volume[87150]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Nov 05 15:04:02 devstack cinder-volume[87150]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 15:04:02 devstack cinder-volume[87150]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Nov 05 15:04:02 devstack cinder-volume[87150]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 05 15:04:02 devstack cinder-volume[87150]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Nov 05 15:04:02 devstack cinder-volume[87150]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Nov 05 15:04:02 devstack cinder-volume[87150]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 15:04:02 devstack cinder-volume[87150]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 05 15:04:02 devstack cinder-volume[87150]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Nov 05 15:04:03 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root
Nov 05 15:04:03 devstack cinder-volume[87150]: INFO oslo.privsep.daemon [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] Spawned new privsep daemon via rootwrap
Nov 05 15:04:03 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] Accepted privsep connection to /tmp/tmp_m921dvy/privsep.sock {{(pid=87150) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Nov 05 15:04:03 devstack cinder-volume[87150]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 05 15:04:03 devstack cinder-volume[87150]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 05 15:04:03 devstack cinder-volume[87150]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 05 15:04:03 devstack cinder-volume[87150]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88380
Nov 05 15:04:03 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ff6abe-04cf-4563-bce6-9ec3575c2e4a]: (2,) {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:04:03 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1efcf1b-d5a2-467c-a888-bccc8200e0bb]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:04:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-40a1f387-4202-4739-858e-b588f87ea62c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:04:03 devstack sudo[88383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-40a1f387-4202-4739-858e-b588f87ea62c
Nov 05 15:04:03 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:04:04 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root
Nov 05 15:04:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-40a1f387-4202-4739-858e-b588f87ea62c" returned: 0 in 0.978s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:04:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-40a1f387-4202-4739-858e-b588f87ea62c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:04:04 devstack sudo[88392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-40a1f387-4202-4739-858e-b588f87ea62c
Nov 05 15:04:04 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:04:05 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root
Nov 05 15:04:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-40a1f387-4202-4739-858e-b588f87ea62c" returned: 0 in 0.846s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:04:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] Lock "cinder-quobyte-40a1f387-4202-4739-858e-b588f87ea62c" released by "delete_volume" :: held 5.017s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:04:05 devstack cinder-volume[87150]: WARNING cinder.quota [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:04:05 devstack cinder-volume[87150]: WARNING cinder.quota [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:04:05 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] Created reservations ['36742ba6-d5f2-4c09-8cb0-9e68d02b0899', 'cacc48b1-eea3-49a8-b347-a459563e0957', '4461b21b-99af-4b87-b99d-a546afae3943', '91eff018-1e82-43c6-9b29-ffb3181574ff'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:04:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:04:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:04:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:04:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:04:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:04:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:04:05 devstack sudo[88418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:04:05 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:04:06 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root
Nov 05 15:04:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.581s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:04:06 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:04:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] Deleted volume successfully.
Nov 05 15:04:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6d246d0a-85bd-42f6-8598-f42c3705d6a1 tempest-VolumesAdminNegativeTest-1039202547 None] Lock "cinder-40a1f387-4202-4739-858e-b588f87ea62c-delete_volume" released by "delete_volume" :: held 6.148s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:04:11 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:04:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Flow 'volume_create_manager' (b07bf71d-3056-4f68-9057-a9a9adedd4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:04:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cbb98ed-09ec-40e1-ab8c-7d189aeb78dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cbb98ed-09ec-40e1-ab8c-7d189aeb78dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-482974895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=006da042-984e-49c7-90a6-677c210d1851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b20e9abca64530ba91717a71491b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:04:11Z,use_quota=True,user_id='68ea3992b1844f33ad0a1a52871db692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28db7e65-c398-46a0-b0cb-45d383d0269a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28db7e65-c398-46a0-b0cb-45d383d0269a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88fdab1f-2ccf-43c4-956d-4cf9f2ef4e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88fdab1f-2ccf-43c4-956d-4cf9f2ef4e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '006da042-984e-49c7-90a6-677c210d1851', 'volume_name': 'volume-006da042-984e-49c7-90a6-677c210d1851', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7287e7bb-104e-4f5e-a748-d289d7c2c72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7287e7bb-104e-4f5e-a748-d289d7c2c72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df134de0-9e79-41f7-b139-15b2146806b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:11 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Volume 006da042-984e-49c7-90a6-677c210d1851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-006da042-984e-49c7-90a6-677c210d1851', 'volume_size': 1}
Nov 05 15:04:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:04:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:04:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-482974895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=006da042-984e-49c7-90a6-677c210d1851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b20e9abca64530ba91717a71491b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:04:11Z,use_quota=True,user_id='68ea3992b1844f33ad0a1a52871db692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:04:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Creating volume 006da042-984e-49c7-90a6-677c210d1851 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:04:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:04:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:04:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:04:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:04:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:04:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:04:11 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:04:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-006da042-984e-49c7-90a6-677c210d1851 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:04:11 devstack sudo[88490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-006da042-984e-49c7-90a6-677c210d1851 1073741824
Nov 05 15:04:11 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:04:11 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root
Nov 05 15:04:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-006da042-984e-49c7-90a6-677c210d1851 1073741824" returned: 0 in 0.548s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:04:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-006da042-984e-49c7-90a6-677c210d1851 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:04:12 devstack sudo[88499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-006da042-984e-49c7-90a6-677c210d1851
Nov 05 15:04:12 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:04:12 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root
Nov 05 15:04:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-006da042-984e-49c7-90a6-677c210d1851" returned: 0 in 0.278s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:04:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:04:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:04:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df134de0-9e79-41f7-b139-15b2146806b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-006da042-984e-49c7-90a6-677c210d1851', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2bd2ff-d330-4d51-aeb5-5a420ba5f964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:12 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Volume volume-006da042-984e-49c7-90a6-677c210d1851 (006da042-984e-49c7-90a6-677c210d1851): created successfully
Nov 05 15:04:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2bd2ff-d330-4d51-aeb5-5a420ba5f964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Flow 'volume_create_manager' (b07bf71d-3056-4f68-9057-a9a9adedd4b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:04:12 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-73e23913-6031-4dae-8d6a-9e540db2460e tempest-ServersNegativeTestJSON-1321163361 None] Created volume successfully.
Nov 05 15:04:17 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:04:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Flow 'volume_create_manager' (cb88969f-7b6f-4f4c-af44-fcb3303da12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:04:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d69dfc2-b7a0-4f9d-b435-14c2e2b3c715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d69dfc2-b7a0-4f9d-b435-14c2e2b3c715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1650121677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06207122-a000-4e7c-9313-759984d82d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b20e9abca64530ba91717a71491b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:04:18Z,use_quota=True,user_id='68ea3992b1844f33ad0a1a52871db692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17247151-43bb-4da6-b030-42ea32f003ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17247151-43bb-4da6-b030-42ea32f003ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abebb162-dd68-48d7-a90c-8a1421f38175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abebb162-dd68-48d7-a90c-8a1421f38175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06207122-a000-4e7c-9313-759984d82d83', 'volume_name': 'volume-06207122-a000-4e7c-9313-759984d82d83', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f10d9992-1546-40ce-baa2-12007e100df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f10d9992-1546-40ce-baa2-12007e100df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af27ac04-b1ac-439f-8af4-b8322b8ce494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:17 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Volume 06207122-a000-4e7c-9313-759984d82d83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06207122-a000-4e7c-9313-759984d82d83', 'volume_size': 1}
Nov 05 15:04:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:04:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:04:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1650121677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06207122-a000-4e7c-9313-759984d82d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b20e9abca64530ba91717a71491b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:04:18Z,use_quota=True,user_id='68ea3992b1844f33ad0a1a52871db692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:04:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Creating volume 06207122-a000-4e7c-9313-759984d82d83 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:04:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:04:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:04:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:04:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:04:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:04:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:04:17 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:04:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06207122-a000-4e7c-9313-759984d82d83 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:04:18 devstack sudo[88534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06207122-a000-4e7c-9313-759984d82d83 1073741824
Nov 05 15:04:18 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:04:18 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root
Nov 05 15:04:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06207122-a000-4e7c-9313-759984d82d83 1073741824" returned: 0 in 0.541s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:04:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06207122-a000-4e7c-9313-759984d82d83 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:04:18 devstack sudo[88541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06207122-a000-4e7c-9313-759984d82d83
Nov 05 15:04:18 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:04:18 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root
Nov 05 15:04:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06207122-a000-4e7c-9313-759984d82d83" returned: 0 in 0.255s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:04:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:04:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:04:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af27ac04-b1ac-439f-8af4-b8322b8ce494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06207122-a000-4e7c-9313-759984d82d83', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad03e3f0-65e4-46e1-930f-debef82bfdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:18 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Volume volume-06207122-a000-4e7c-9313-759984d82d83 (06207122-a000-4e7c-9313-759984d82d83): created successfully
Nov 05 15:04:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad03e3f0-65e4-46e1-930f-debef82bfdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Flow 'volume_create_manager' (cb88969f-7b6f-4f4c-af44-fcb3303da12f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:04:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5d8a80bd-d05f-4b5b-bcee-fb554b418984 tempest-ServersNegativeTestJSON-1321163361 None] Created volume successfully.
Nov 05 15:04:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-079fae49-63d8-4a7a-a2fc-d3e96ee2cd28 tempest-ServersNegativeTestJSON-1321163361 None] Acquiring lock "cinder-06207122-a000-4e7c-9313-759984d82d83-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:04:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-079fae49-63d8-4a7a-a2fc-d3e96ee2cd28 tempest-ServersNegativeTestJSON-1321163361 None] Lock "cinder-06207122-a000-4e7c-9313-759984d82d83-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:04:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-079fae49-63d8-4a7a-a2fc-d3e96ee2cd28 tempest-ServersNegativeTestJSON-1321163361 None] Acquiring lock "cinder-quobyte-06207122-a000-4e7c-9313-759984d82d83" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:04:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-079fae49-63d8-4a7a-a2fc-d3e96ee2cd28 tempest-ServersNegativeTestJSON-1321163361 None] Lock "cinder-quobyte-06207122-a000-4e7c-9313-759984d82d83" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:04:22 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fc6fe3-2cdb-4978-929c-546445276a91]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:04:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-079fae49-63d8-4a7a-a2fc-d3e96ee2cd28 tempest-ServersNegativeTestJSON-1321163361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06207122-a000-4e7c-9313-759984d82d83 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:04:22 devstack sudo[88572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06207122-a000-4e7c-9313-759984d82d83
Nov 05 15:04:22 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:04:23 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root
Nov 05 15:04:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-079fae49-63d8-4a7a-a2fc-d3e96ee2cd28 tempest-ServersNegativeTestJSON-1321163361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06207122-a000-4e7c-9313-759984d82d83" returned: 0 in 0.463s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:04:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-079fae49-63d8-4a7a-a2fc-d3e96ee2cd28 tempest-ServersNegativeTestJSON-1321163361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06207122-a000-4e7c-9313-759984d82d83 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:04:23 devstack sudo[88577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06207122-a000-4e7c-9313-759984d82d83
Nov 05 15:04:23 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:04:23 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root
Nov 05 15:04:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-079fae49-63d8-4a7a-a2fc-d3e96ee2cd28 tempest-ServersNegativeTestJSON-1321163361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06207122-a000-4e7c-9313-759984d82d83" returned: 0 in 0.313s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:04:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-079fae49-63d8-4a7a-a2fc-d3e96ee2cd28 tempest-ServersNegativeTestJSON-1321163361 None] Lock "cinder-quobyte-06207122-a000-4e7c-9313-759984d82d83" released by "delete_volume" :: held 0.834s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:04:23 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-079fae49-63d8-4a7a-a2fc-d3e96ee2cd28 tempest-ServersNegativeTestJSON-1321163361 None] Created reservations ['c7f3495b-5517-4561-8de2-c73e60a25e59', '8a6195be-727c-4906-8fe0-09ea72397761', 'a1ffb182-9cd0-4a8a-baa8-3bcc85e48498', '60aeb3fe-8dfc-4246-8096-0836dbc19c37'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:04:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-079fae49-63d8-4a7a-a2fc-d3e96ee2cd28 tempest-ServersNegativeTestJSON-1321163361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:04:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-079fae49-63d8-4a7a-a2fc-d3e96ee2cd28 tempest-ServersNegativeTestJSON-1321163361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:04:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-079fae49-63d8-4a7a-a2fc-d3e96ee2cd28 tempest-ServersNegativeTestJSON-1321163361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:04:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-079fae49-63d8-4a7a-a2fc-d3e96ee2cd28 tempest-ServersNegativeTestJSON-1321163361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:04:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-079fae49-63d8-4a7a-a2fc-d3e96ee2cd28 tempest-ServersNegativeTestJSON-1321163361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:04:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-079fae49-63d8-4a7a-a2fc-d3e96ee2cd28 tempest-ServersNegativeTestJSON-1321163361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:04:23 devstack sudo[88582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:04:23 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:04:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-db39a4a3-1f46-42cd-b353-7171163f540d tempest-ServersNegativeTestJSON-1321163361 None] Acquiring lock "cinder-006da042-984e-49c7-90a6-677c210d1851-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:04:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-db39a4a3-1f46-42cd-b353-7171163f540d tempest-ServersNegativeTestJSON-1321163361 None] Lock "cinder-006da042-984e-49c7-90a6-677c210d1851-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:04:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-db39a4a3-1f46-42cd-b353-7171163f540d tempest-ServersNegativeTestJSON-1321163361 None] Acquiring lock "cinder-quobyte-006da042-984e-49c7-90a6-677c210d1851" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:04:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-db39a4a3-1f46-42cd-b353-7171163f540d tempest-ServersNegativeTestJSON-1321163361 None] Lock "cinder-quobyte-006da042-984e-49c7-90a6-677c210d1851" acquired by "delete_volume" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:04:23 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c41edc-bf4f-49dd-ad65-e251deddeab8]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:04:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-db39a4a3-1f46-42cd-b353-7171163f540d tempest-ServersNegativeTestJSON-1321163361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-006da042-984e-49c7-90a6-677c210d1851 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:04:23 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root
Nov 05 15:04:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-079fae49-63d8-4a7a-a2fc-d3e96ee2cd28 tempest-ServersNegativeTestJSON-1321163361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.337s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:04:23 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-079fae49-63d8-4a7a-a2fc-d3e96ee2cd28 tempest-ServersNegativeTestJSON-1321163361 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:04:23 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-079fae49-63d8-4a7a-a2fc-d3e96ee2cd28 tempest-ServersNegativeTestJSON-1321163361 None] Deleted volume successfully.
Nov 05 15:04:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-079fae49-63d8-4a7a-a2fc-d3e96ee2cd28 tempest-ServersNegativeTestJSON-1321163361 None] Lock "cinder-06207122-a000-4e7c-9313-759984d82d83-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:04:24 devstack sudo[88585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-006da042-984e-49c7-90a6-677c210d1851
Nov 05 15:04:24 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:04:24 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root
Nov 05 15:04:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-db39a4a3-1f46-42cd-b353-7171163f540d tempest-ServersNegativeTestJSON-1321163361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-006da042-984e-49c7-90a6-677c210d1851" returned: 0 in 0.386s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:04:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-db39a4a3-1f46-42cd-b353-7171163f540d tempest-ServersNegativeTestJSON-1321163361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-006da042-984e-49c7-90a6-677c210d1851 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:04:24 devstack sudo[88590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-006da042-984e-49c7-90a6-677c210d1851
Nov 05 15:04:24 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:04:24 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root
Nov 05 15:04:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-db39a4a3-1f46-42cd-b353-7171163f540d tempest-ServersNegativeTestJSON-1321163361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-006da042-984e-49c7-90a6-677c210d1851" returned: 0 in 0.342s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:04:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-db39a4a3-1f46-42cd-b353-7171163f540d tempest-ServersNegativeTestJSON-1321163361 None] Lock "cinder-quobyte-006da042-984e-49c7-90a6-677c210d1851" released by "delete_volume" :: held 0.794s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:04:24 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-db39a4a3-1f46-42cd-b353-7171163f540d tempest-ServersNegativeTestJSON-1321163361 None] Created reservations ['68398f57-d115-4bfd-917d-bc1e37cece3d', 'cd43b48d-6d6e-48b2-9a88-3bdc193714be', '2412b4c4-f519-45ad-a080-2f22dc9af468', '7f626fa1-383b-4fe3-9e0b-9a9f2925aa71'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:04:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-db39a4a3-1f46-42cd-b353-7171163f540d tempest-ServersNegativeTestJSON-1321163361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:04:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-db39a4a3-1f46-42cd-b353-7171163f540d tempest-ServersNegativeTestJSON-1321163361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:04:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-db39a4a3-1f46-42cd-b353-7171163f540d tempest-ServersNegativeTestJSON-1321163361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:04:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-db39a4a3-1f46-42cd-b353-7171163f540d tempest-ServersNegativeTestJSON-1321163361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:04:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-db39a4a3-1f46-42cd-b353-7171163f540d tempest-ServersNegativeTestJSON-1321163361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:04:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-db39a4a3-1f46-42cd-b353-7171163f540d tempest-ServersNegativeTestJSON-1321163361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:04:24 devstack sudo[88593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:04:24 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:04:25 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root
Nov 05 15:04:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-db39a4a3-1f46-42cd-b353-7171163f540d tempest-ServersNegativeTestJSON-1321163361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.398s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:04:25 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-db39a4a3-1f46-42cd-b353-7171163f540d tempest-ServersNegativeTestJSON-1321163361 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:04:25 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-db39a4a3-1f46-42cd-b353-7171163f540d tempest-ServersNegativeTestJSON-1321163361 None] Deleted volume successfully.
Nov 05 15:04:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-db39a4a3-1f46-42cd-b353-7171163f540d tempest-ServersNegativeTestJSON-1321163361 None] Lock "cinder-006da042-984e-49c7-90a6-677c210d1851-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:04:36 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=24,cinder:UPDATE=32,cinder:DELETE=4,cinder:INSERT=5 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:04:36 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=35,cinder:SELECT=19,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:04:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:04:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:04:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:04:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:04:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:04:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:04:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:04:37 devstack sudo[88722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:04:37 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:04:37 devstack cinder-volume[87150]: WARNING py.warnings [req-ebde02d3-7d51-42b1-9c9e-8004ce81f143 req-f128a352-f5e1-4c00-b458-151d3b5e280f tempest-TaggedAttachmentsTest-293454082 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Nov 05 15:04:37 devstack cinder-volume[87150]:   .first()
Nov 05 15:04:37 devstack cinder-volume[87150]: 
Nov 05 15:04:37 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root
Nov 05 15:04:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.325s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:04:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:04:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-ebde02d3-7d51-42b1-9c9e-8004ce81f143 req-f128a352-f5e1-4c00-b458-151d3b5e280f tempest-TaggedAttachmentsTest-293454082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:04:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-ebde02d3-7d51-42b1-9c9e-8004ce81f143 req-f128a352-f5e1-4c00-b458-151d3b5e280f tempest-TaggedAttachmentsTest-293454082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:04:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-ebde02d3-7d51-42b1-9c9e-8004ce81f143 req-f128a352-f5e1-4c00-b458-151d3b5e280f tempest-TaggedAttachmentsTest-293454082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:04:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-ebde02d3-7d51-42b1-9c9e-8004ce81f143 req-f128a352-f5e1-4c00-b458-151d3b5e280f tempest-TaggedAttachmentsTest-293454082 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628', 'name': 'volume-c73e598e-86de-48ad-82b4-f96b41364028', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '137cbdc9-46d6-4706-a4bc-4018c9cb706c', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 15:04:37 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-ebde02d3-7d51-42b1-9c9e-8004ce81f143 req-f128a352-f5e1-4c00-b458-151d3b5e280f tempest-TaggedAttachmentsTest-293454082 None] attachment_update completed successfully.
Nov 05 15:04:42 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:04:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Flow 'volume_create_manager' (84c5a145-88ec-4061-96b1-380d656769c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:04:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (779efce9-d714-4d4b-b09d-76af6ac09504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (779efce9-d714-4d4b-b09d-76af6ac09504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-359759969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a29f3af6-f478-434c-a10a-8c99b26ee8f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8de90a942a54d8a93b8ed0d45bd5357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:04:42Z,use_quota=True,user_id='f88c85dafef845b9b825bbad88fdcc2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7916b079-2871-4997-bbdd-74f2a8df299d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7916b079-2871-4997-bbdd-74f2a8df299d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c2aca6-6354-4615-abfb-8834a467c727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c2aca6-6354-4615-abfb-8834a467c727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a29f3af6-f478-434c-a10a-8c99b26ee8f9', 'volume_name': 'volume-a29f3af6-f478-434c-a10a-8c99b26ee8f9', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1bba7ce-2195-4c7b-8dcb-2c6ae99e8e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1bba7ce-2195-4c7b-8dcb-2c6ae99e8e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (203824fa-3ff5-4297-bc4c-ff0bc92843ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:42 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Volume a29f3af6-f478-434c-a10a-8c99b26ee8f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a29f3af6-f478-434c-a10a-8c99b26ee8f9', 'volume_size': 1}
Nov 05 15:04:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:04:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:04:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-359759969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a29f3af6-f478-434c-a10a-8c99b26ee8f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8de90a942a54d8a93b8ed0d45bd5357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:04:42Z,use_quota=True,user_id='f88c85dafef845b9b825bbad88fdcc2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:04:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Creating volume a29f3af6-f478-434c-a10a-8c99b26ee8f9 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:04:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:04:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:04:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:04:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:04:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:04:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:04:42 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:04:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a29f3af6-f478-434c-a10a-8c99b26ee8f9 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:04:42 devstack sudo[89228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a29f3af6-f478-434c-a10a-8c99b26ee8f9 1073741824
Nov 05 15:04:42 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:04:43 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root
Nov 05 15:04:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a29f3af6-f478-434c-a10a-8c99b26ee8f9 1073741824" returned: 0 in 0.921s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:04:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a29f3af6-f478-434c-a10a-8c99b26ee8f9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:04:43 devstack sudo[89237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a29f3af6-f478-434c-a10a-8c99b26ee8f9
Nov 05 15:04:43 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:04:44 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-6921a675-dd0a-48b9-9f9f-069ed650fcde req-ee787ffa-0465-4e6b-acd7-f4483d1c62b5 tempest-TaggedAttachmentsTest-293454082 None] Terminate volume connection completed successfully.
Nov 05 15:04:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-6921a675-dd0a-48b9-9f9f-069ed650fcde req-ee787ffa-0465-4e6b-acd7-f4483d1c62b5 tempest-TaggedAttachmentsTest-293454082 None] Deleting attachment 137cbdc9-46d6-4706-a4bc-4018c9cb706c. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 15:04:44 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root
Nov 05 15:04:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a29f3af6-f478-434c-a10a-8c99b26ee8f9" returned: 0 in 0.466s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:04:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:04:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:04:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (203824fa-3ff5-4297-bc4c-ff0bc92843ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a29f3af6-f478-434c-a10a-8c99b26ee8f9', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b65d08-9b5a-4c82-a70f-f12c844723f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:44 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Volume volume-a29f3af6-f478-434c-a10a-8c99b26ee8f9 (a29f3af6-f478-434c-a10a-8c99b26ee8f9): created successfully
Nov 05 15:04:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b65d08-9b5a-4c82-a70f-f12c844723f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Flow 'volume_create_manager' (84c5a145-88ec-4061-96b1-380d656769c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:04:44 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-6cd34878-78e8-42e6-bc84-b28518c7f4fa req-8926af39-3527-4a07-96fa-21b771667d02 tempest-VolumesGetTestJSON-319752321 None] Created volume successfully.
Nov 05 15:04:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-5553b2b5-de63-413a-878a-a542a4730ca4 req-32136d33-c87f-4881-a438-10265518752c tempest-VolumesGetTestJSON-319752321 None] Acquiring lock "cinder-a29f3af6-f478-434c-a10a-8c99b26ee8f9-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:04:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-5553b2b5-de63-413a-878a-a542a4730ca4 req-32136d33-c87f-4881-a438-10265518752c tempest-VolumesGetTestJSON-319752321 None] Lock "cinder-a29f3af6-f478-434c-a10a-8c99b26ee8f9-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:04:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-5553b2b5-de63-413a-878a-a542a4730ca4 req-32136d33-c87f-4881-a438-10265518752c tempest-VolumesGetTestJSON-319752321 None] Acquiring lock "cinder-quobyte-a29f3af6-f478-434c-a10a-8c99b26ee8f9" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:04:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-5553b2b5-de63-413a-878a-a542a4730ca4 req-32136d33-c87f-4881-a438-10265518752c tempest-VolumesGetTestJSON-319752321 None] Lock "cinder-quobyte-a29f3af6-f478-434c-a10a-8c99b26ee8f9" acquired by "delete_volume" :: waited 0.028s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:04:45 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e6d58f-84a5-4f6c-9205-4dbc34830847]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:04:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-5553b2b5-de63-413a-878a-a542a4730ca4 req-32136d33-c87f-4881-a438-10265518752c tempest-VolumesGetTestJSON-319752321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a29f3af6-f478-434c-a10a-8c99b26ee8f9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:04:45 devstack sudo[89284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a29f3af6-f478-434c-a10a-8c99b26ee8f9
Nov 05 15:04:45 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:04:46 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root
Nov 05 15:04:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-5553b2b5-de63-413a-878a-a542a4730ca4 req-32136d33-c87f-4881-a438-10265518752c tempest-VolumesGetTestJSON-319752321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a29f3af6-f478-434c-a10a-8c99b26ee8f9" returned: 0 in 0.449s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:04:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-5553b2b5-de63-413a-878a-a542a4730ca4 req-32136d33-c87f-4881-a438-10265518752c tempest-VolumesGetTestJSON-319752321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a29f3af6-f478-434c-a10a-8c99b26ee8f9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:04:46 devstack sudo[89291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a29f3af6-f478-434c-a10a-8c99b26ee8f9
Nov 05 15:04:46 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:04:46 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root
Nov 05 15:04:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-5553b2b5-de63-413a-878a-a542a4730ca4 req-32136d33-c87f-4881-a438-10265518752c tempest-VolumesGetTestJSON-319752321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a29f3af6-f478-434c-a10a-8c99b26ee8f9" returned: 0 in 0.355s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:04:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-5553b2b5-de63-413a-878a-a542a4730ca4 req-32136d33-c87f-4881-a438-10265518752c tempest-VolumesGetTestJSON-319752321 None] Lock "cinder-quobyte-a29f3af6-f478-434c-a10a-8c99b26ee8f9" released by "delete_volume" :: held 0.885s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:04:46 devstack cinder-volume[87150]: DEBUG cinder.quota [req-5553b2b5-de63-413a-878a-a542a4730ca4 req-32136d33-c87f-4881-a438-10265518752c tempest-VolumesGetTestJSON-319752321 None] Created reservations ['b927a75e-9ec5-4928-85ae-182146e3abdf', '8bd3fb72-4a8a-4145-9e79-afcea2dedbf0', 'f4dd7204-349a-449a-891a-aab059d6cb90', '8b0d6fe9-a713-457b-9c60-4518c8c76a77'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:04:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-5553b2b5-de63-413a-878a-a542a4730ca4 req-32136d33-c87f-4881-a438-10265518752c tempest-VolumesGetTestJSON-319752321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:04:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-5553b2b5-de63-413a-878a-a542a4730ca4 req-32136d33-c87f-4881-a438-10265518752c tempest-VolumesGetTestJSON-319752321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:04:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-5553b2b5-de63-413a-878a-a542a4730ca4 req-32136d33-c87f-4881-a438-10265518752c tempest-VolumesGetTestJSON-319752321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:04:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-5553b2b5-de63-413a-878a-a542a4730ca4 req-32136d33-c87f-4881-a438-10265518752c tempest-VolumesGetTestJSON-319752321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:04:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-5553b2b5-de63-413a-878a-a542a4730ca4 req-32136d33-c87f-4881-a438-10265518752c tempest-VolumesGetTestJSON-319752321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:04:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-5553b2b5-de63-413a-878a-a542a4730ca4 req-32136d33-c87f-4881-a438-10265518752c tempest-VolumesGetTestJSON-319752321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:04:47 devstack sudo[89294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:04:47 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:04:47 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root
Nov 05 15:04:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-5553b2b5-de63-413a-878a-a542a4730ca4 req-32136d33-c87f-4881-a438-10265518752c tempest-VolumesGetTestJSON-319752321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.370s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:04:47 devstack cinder-volume[87150]: DEBUG cinder.manager [req-5553b2b5-de63-413a-878a-a542a4730ca4 req-32136d33-c87f-4881-a438-10265518752c tempest-VolumesGetTestJSON-319752321 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:04:47 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-5553b2b5-de63-413a-878a-a542a4730ca4 req-32136d33-c87f-4881-a438-10265518752c tempest-VolumesGetTestJSON-319752321 None] Deleted volume successfully.
Nov 05 15:04:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-5553b2b5-de63-413a-878a-a542a4730ca4 req-32136d33-c87f-4881-a438-10265518752c tempest-VolumesGetTestJSON-319752321 None] Lock "cinder-a29f3af6-f478-434c-a10a-8c99b26ee8f9-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:04:55 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:04:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Flow 'volume_create_manager' (8d8d8729-e99f-49d8-93ad-f0e41a1b324e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:04:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40439e1-6d7b-47b2-b8bf-10232b825eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40439e1-6d7b-47b2-b8bf-10232b825eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1897850211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3febb632-9a03-4c3e-8f45-b69f10ab2a6a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88155ab55ecb44fc92806dc2149eab5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:04:56Z,use_quota=True,user_id='a0c2f0f5b49f455aa0d34c9f146ae487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a55ad06-72bb-4a65-b003-0ea09c905383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a55ad06-72bb-4a65-b003-0ea09c905383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (059fbe90-4e69-44f3-990b-c5b175928d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (059fbe90-4e69-44f3-990b-c5b175928d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3febb632-9a03-4c3e-8f45-b69f10ab2a6a', 'volume_name': 'volume-3febb632-9a03-4c3e-8f45-b69f10ab2a6a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62948742-bc4c-4554-8911-bdb4ad8a0c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62948742-bc4c-4554-8911-bdb4ad8a0c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32213deb-4ab6-44ba-bd0a-a9efea157b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:55 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Volume 3febb632-9a03-4c3e-8f45-b69f10ab2a6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3febb632-9a03-4c3e-8f45-b69f10ab2a6a', 'volume_size': 1}
Nov 05 15:04:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:04:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:04:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1897850211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3febb632-9a03-4c3e-8f45-b69f10ab2a6a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88155ab55ecb44fc92806dc2149eab5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:04:56Z,use_quota=True,user_id='a0c2f0f5b49f455aa0d34c9f146ae487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:04:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Creating volume 3febb632-9a03-4c3e-8f45-b69f10ab2a6a {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:04:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:04:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:04:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:04:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:04:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:04:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:04:55 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:04:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3febb632-9a03-4c3e-8f45-b69f10ab2a6a 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:04:55 devstack sudo[89396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3febb632-9a03-4c3e-8f45-b69f10ab2a6a 1073741824
Nov 05 15:04:55 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:04:56 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root
Nov 05 15:04:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3febb632-9a03-4c3e-8f45-b69f10ab2a6a 1073741824" returned: 0 in 0.474s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:04:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3febb632-9a03-4c3e-8f45-b69f10ab2a6a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:04:56 devstack sudo[89402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3febb632-9a03-4c3e-8f45-b69f10ab2a6a
Nov 05 15:04:56 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:04:56 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root
Nov 05 15:04:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3febb632-9a03-4c3e-8f45-b69f10ab2a6a" returned: 0 in 0.292s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:04:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:04:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:04:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32213deb-4ab6-44ba-bd0a-a9efea157b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3febb632-9a03-4c3e-8f45-b69f10ab2a6a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae44585d-a279-43c5-a8e3-07a265cb626c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:56 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Volume volume-3febb632-9a03-4c3e-8f45-b69f10ab2a6a (3febb632-9a03-4c3e-8f45-b69f10ab2a6a): created successfully
Nov 05 15:04:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae44585d-a279-43c5-a8e3-07a265cb626c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Flow 'volume_create_manager' (8d8d8729-e99f-49d8-93ad-f0e41a1b324e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:04:56 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d86a983d-ebfd-4636-b1fd-dd5f93714c28 tempest-VolumesTestJSON-311822292 None] Created volume successfully.
Nov 05 15:04:58 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:04:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Flow 'volume_create_manager' (9f575577-f9f4-4589-8741-9d6978e4b073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:04:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f5d335e-2343-49e9-bbff-a4ff7e0ebcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f5d335e-2343-49e9-bbff-a4ff7e0ebcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1384327020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c21eb34a-d4ed-462f-8f03-f505699335dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88155ab55ecb44fc92806dc2149eab5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:04:59Z,use_quota=True,user_id='a0c2f0f5b49f455aa0d34c9f146ae487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cee08f4-7ef3-4642-a48a-8fed1516fee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cee08f4-7ef3-4642-a48a-8fed1516fee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a93dc8c-3f57-44ed-8efd-091f0ecd98a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a93dc8c-3f57-44ed-8efd-091f0ecd98a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c21eb34a-d4ed-462f-8f03-f505699335dc', 'volume_name': 'volume-c21eb34a-d4ed-462f-8f03-f505699335dc', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b52f04-f705-4f79-a1a4-bb0e3d24a75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b52f04-f705-4f79-a1a4-bb0e3d24a75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:04:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d61fd1-4db6-49b9-a118-7c69a5265c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:04:58 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Volume c21eb34a-d4ed-462f-8f03-f505699335dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c21eb34a-d4ed-462f-8f03-f505699335dc', 'volume_size': 1}
Nov 05 15:04:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:04:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:04:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1384327020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c21eb34a-d4ed-462f-8f03-f505699335dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88155ab55ecb44fc92806dc2149eab5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:04:59Z,use_quota=True,user_id='a0c2f0f5b49f455aa0d34c9f146ae487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:04:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Creating volume c21eb34a-d4ed-462f-8f03-f505699335dc {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:04:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:04:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:04:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:04:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:04:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:04:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:04:58 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:04:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c21eb34a-d4ed-462f-8f03-f505699335dc 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:04:59 devstack sudo[89478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c21eb34a-d4ed-462f-8f03-f505699335dc 1073741824
Nov 05 15:04:59 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:04:59 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root
Nov 05 15:04:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c21eb34a-d4ed-462f-8f03-f505699335dc 1073741824" returned: 0 in 0.721s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:04:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c21eb34a-d4ed-462f-8f03-f505699335dc {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:04:59 devstack sudo[89488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c21eb34a-d4ed-462f-8f03-f505699335dc
Nov 05 15:04:59 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:00 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c21eb34a-d4ed-462f-8f03-f505699335dc" returned: 0 in 0.269s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:05:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d61fd1-4db6-49b9-a118-7c69a5265c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c21eb34a-d4ed-462f-8f03-f505699335dc', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e230e0-44d9-4e46-9a7b-4aceaeb15ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:00 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Volume volume-c21eb34a-d4ed-462f-8f03-f505699335dc (c21eb34a-d4ed-462f-8f03-f505699335dc): created successfully
Nov 05 15:05:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e230e0-44d9-4e46-9a7b-4aceaeb15ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Flow 'volume_create_manager' (9f575577-f9f4-4589-8741-9d6978e4b073) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:05:00 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9fc933f3-24fc-4aa8-b96b-58fb5e6a04a1 tempest-VolumesTestJSON-311822292 None] Created volume successfully.
Nov 05 15:05:00 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:05:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Flow 'volume_create_manager' (06bf5e61-26f5-4cab-a42d-bc65d0866b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:05:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f960b411-7873-4271-b9b7-b9fa12b6050d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f960b411-7873-4271-b9b7-b9fa12b6050d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-994182844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b070237-0d00-47c9-b701-720ef58f7aa5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88155ab55ecb44fc92806dc2149eab5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:01Z,use_quota=True,user_id='a0c2f0f5b49f455aa0d34c9f146ae487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d1c166-cc2c-43c8-88f9-df83a30621a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d1c166-cc2c-43c8-88f9-df83a30621a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03860495-1e17-4a12-b043-cf1cd6e717ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03860495-1e17-4a12-b043-cf1cd6e717ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b070237-0d00-47c9-b701-720ef58f7aa5', 'volume_name': 'volume-1b070237-0d00-47c9-b701-720ef58f7aa5', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47aa33f0-778a-4b85-af27-00b21acea3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47aa33f0-778a-4b85-af27-00b21acea3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df6686e-4c13-4842-801e-dfe27324b687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:01 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Volume 1b070237-0d00-47c9-b701-720ef58f7aa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b070237-0d00-47c9-b701-720ef58f7aa5', 'volume_size': 1}
Nov 05 15:05:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-994182844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b070237-0d00-47c9-b701-720ef58f7aa5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88155ab55ecb44fc92806dc2149eab5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:01Z,use_quota=True,user_id='a0c2f0f5b49f455aa0d34c9f146ae487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:05:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Creating volume 1b070237-0d00-47c9-b701-720ef58f7aa5 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:05:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:05:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:05:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:05:01 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:05:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1b070237-0d00-47c9-b701-720ef58f7aa5 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:01 devstack sudo[89491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1b070237-0d00-47c9-b701-720ef58f7aa5 1073741824
Nov 05 15:05:01 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5266e80f-67a0-481d-8845-a8f7bd5fed56 tempest-TaggedAttachmentsTest-293454082 None] Acquiring lock "cinder-c73e598e-86de-48ad-82b4-f96b41364028-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:05:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5266e80f-67a0-481d-8845-a8f7bd5fed56 tempest-TaggedAttachmentsTest-293454082 None] Lock "cinder-c73e598e-86de-48ad-82b4-f96b41364028-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:05:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5266e80f-67a0-481d-8845-a8f7bd5fed56 tempest-TaggedAttachmentsTest-293454082 None] Acquiring lock "cinder-quobyte-c73e598e-86de-48ad-82b4-f96b41364028" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5266e80f-67a0-481d-8845-a8f7bd5fed56 tempest-TaggedAttachmentsTest-293454082 None] Lock "cinder-quobyte-c73e598e-86de-48ad-82b4-f96b41364028" acquired by "delete_volume" :: waited 0.050s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff5395b-536a-4d2a-8dd8-de48e9828c53]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5266e80f-67a0-481d-8845-a8f7bd5fed56 tempest-TaggedAttachmentsTest-293454082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c73e598e-86de-48ad-82b4-f96b41364028 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:02 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1b070237-0d00-47c9-b701-720ef58f7aa5 1073741824" returned: 0 in 1.120s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1b070237-0d00-47c9-b701-720ef58f7aa5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:02 devstack sudo[89502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1b070237-0d00-47c9-b701-720ef58f7aa5
Nov 05 15:05:02 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:02 devstack sudo[89501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c73e598e-86de-48ad-82b4-f96b41364028
Nov 05 15:05:02 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:02 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1b070237-0d00-47c9-b701-720ef58f7aa5" returned: 0 in 0.419s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df6686e-4c13-4842-801e-dfe27324b687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b070237-0d00-47c9-b701-720ef58f7aa5', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf981e7-b6df-42cc-b1cb-c0908c7e26f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:02 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:02 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Volume volume-1b070237-0d00-47c9-b701-720ef58f7aa5 (1b070237-0d00-47c9-b701-720ef58f7aa5): created successfully
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf981e7-b6df-42cc-b1cb-c0908c7e26f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Flow 'volume_create_manager' (06bf5e61-26f5-4cab-a42d-bc65d0866b9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5266e80f-67a0-481d-8845-a8f7bd5fed56 tempest-TaggedAttachmentsTest-293454082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c73e598e-86de-48ad-82b4-f96b41364028" returned: 0 in 0.674s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5266e80f-67a0-481d-8845-a8f7bd5fed56 tempest-TaggedAttachmentsTest-293454082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c73e598e-86de-48ad-82b4-f96b41364028 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:02 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-dd50c9cc-aebf-4dee-acc1-9d003c1a7304 tempest-VolumesTestJSON-311822292 None] Created volume successfully.
Nov 05 15:05:02 devstack sudo[89510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c73e598e-86de-48ad-82b4-f96b41364028
Nov 05 15:05:02 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Flow 'volume_create_manager' (2e170e87-c628-4698-bbbf-d689e2e0d406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab46d63-a22e-44fd-9bba-28cf6a5298a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab46d63-a22e-44fd-9bba-28cf6a5298a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2044943681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c01cab4f-ed4b-45f8-856d-18cd1b01ca95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a265711e34604cf3ad90dd982b289bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:03Z,use_quota=True,user_id='030a2a787ba04b7da85d69d8814e8b89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e4e27c-e374-4ef0-9ba7-0bbee760009e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e4e27c-e374-4ef0-9ba7-0bbee760009e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (914b60ed-6eb7-42bc-bc43-4f1b5ecb9d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (914b60ed-6eb7-42bc-bc43-4f1b5ecb9d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c01cab4f-ed4b-45f8-856d-18cd1b01ca95', 'volume_name': 'volume-c01cab4f-ed4b-45f8-856d-18cd1b01ca95', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b15119-552f-464e-82c2-3662eb624dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b15119-552f-464e-82c2-3662eb624dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c751b1c9-ae4d-4736-bee4-488e996ee0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:02 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Volume c01cab4f-ed4b-45f8-856d-18cd1b01ca95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c01cab4f-ed4b-45f8-856d-18cd1b01ca95', 'volume_size': 1}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2044943681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c01cab4f-ed4b-45f8-856d-18cd1b01ca95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a265711e34604cf3ad90dd982b289bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:03Z,use_quota=True,user_id='030a2a787ba04b7da85d69d8814e8b89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Creating volume c01cab4f-ed4b-45f8-856d-18cd1b01ca95 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:05:02 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:05:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c01cab4f-ed4b-45f8-856d-18cd1b01ca95 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:02 devstack sudo[89512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c01cab4f-ed4b-45f8-856d-18cd1b01ca95 1073741824
Nov 05 15:05:02 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:03 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5266e80f-67a0-481d-8845-a8f7bd5fed56 tempest-TaggedAttachmentsTest-293454082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c73e598e-86de-48ad-82b4-f96b41364028" returned: 0 in 0.341s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5266e80f-67a0-481d-8845-a8f7bd5fed56 tempest-TaggedAttachmentsTest-293454082 None] Lock "cinder-quobyte-c73e598e-86de-48ad-82b4-f96b41364028" released by "delete_volume" :: held 1.090s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:05:03 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-5266e80f-67a0-481d-8845-a8f7bd5fed56 tempest-TaggedAttachmentsTest-293454082 None] Created reservations ['d5660ab9-0579-403f-b6f6-601e60078fe3', '75623c75-ec60-4e21-a29a-b7030736c9a9', '169a6a88-1c32-4442-97d1-e99ce0d9f997', 'c740a882-55bb-4909-b78b-822aee6cb960'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:05:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5266e80f-67a0-481d-8845-a8f7bd5fed56 tempest-TaggedAttachmentsTest-293454082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5266e80f-67a0-481d-8845-a8f7bd5fed56 tempest-TaggedAttachmentsTest-293454082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5266e80f-67a0-481d-8845-a8f7bd5fed56 tempest-TaggedAttachmentsTest-293454082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:05:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5266e80f-67a0-481d-8845-a8f7bd5fed56 tempest-TaggedAttachmentsTest-293454082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:05:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5266e80f-67a0-481d-8845-a8f7bd5fed56 tempest-TaggedAttachmentsTest-293454082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5266e80f-67a0-481d-8845-a8f7bd5fed56 tempest-TaggedAttachmentsTest-293454082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:03 devstack sudo[89519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:05:03 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:03 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c01cab4f-ed4b-45f8-856d-18cd1b01ca95 1073741824" returned: 0 in 0.715s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c01cab4f-ed4b-45f8-856d-18cd1b01ca95 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:03 devstack sudo[89521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c01cab4f-ed4b-45f8-856d-18cd1b01ca95
Nov 05 15:05:03 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:03 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5266e80f-67a0-481d-8845-a8f7bd5fed56 tempest-TaggedAttachmentsTest-293454082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.358s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:03 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-5266e80f-67a0-481d-8845-a8f7bd5fed56 tempest-TaggedAttachmentsTest-293454082 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:05:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5266e80f-67a0-481d-8845-a8f7bd5fed56 tempest-TaggedAttachmentsTest-293454082 None] Deleted volume successfully.
Nov 05 15:05:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5266e80f-67a0-481d-8845-a8f7bd5fed56 tempest-TaggedAttachmentsTest-293454082 None] Lock "cinder-c73e598e-86de-48ad-82b4-f96b41364028-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:05:03 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c01cab4f-ed4b-45f8-856d-18cd1b01ca95" returned: 0 in 0.324s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:05:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c751b1c9-ae4d-4736-bee4-488e996ee0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c01cab4f-ed4b-45f8-856d-18cd1b01ca95', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9aec00-1ee2-47d0-b32b-1ddba2802e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:04 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Volume volume-c01cab4f-ed4b-45f8-856d-18cd1b01ca95 (c01cab4f-ed4b-45f8-856d-18cd1b01ca95): created successfully
Nov 05 15:05:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9aec00-1ee2-47d0-b32b-1ddba2802e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Flow 'volume_create_manager' (2e170e87-c628-4698-bbbf-d689e2e0d406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:05:04 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-65e58b77-97b0-4a00-baa8-430f7622d6b0 tempest-DeleteServersTestJSON-2067802414 None] Created volume successfully.
Nov 05 15:05:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0d749a34-16dc-47df-99cb-197699c20897 tempest-VolumesTestJSON-311822292 None] Acquiring lock "cinder-1b070237-0d00-47c9-b701-720ef58f7aa5-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:05:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0d749a34-16dc-47df-99cb-197699c20897 tempest-VolumesTestJSON-311822292 None] Lock "cinder-1b070237-0d00-47c9-b701-720ef58f7aa5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:05:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0d749a34-16dc-47df-99cb-197699c20897 tempest-VolumesTestJSON-311822292 None] Acquiring lock "cinder-quobyte-1b070237-0d00-47c9-b701-720ef58f7aa5" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:05:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0d749a34-16dc-47df-99cb-197699c20897 tempest-VolumesTestJSON-311822292 None] Lock "cinder-quobyte-1b070237-0d00-47c9-b701-720ef58f7aa5" acquired by "delete_volume" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:05:04 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[79eabf2a-6416-49df-a49e-b7afe7a69981]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:05:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0d749a34-16dc-47df-99cb-197699c20897 tempest-VolumesTestJSON-311822292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1b070237-0d00-47c9-b701-720ef58f7aa5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:04 devstack sudo[89525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1b070237-0d00-47c9-b701-720ef58f7aa5
Nov 05 15:05:04 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:04 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0d749a34-16dc-47df-99cb-197699c20897 tempest-VolumesTestJSON-311822292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1b070237-0d00-47c9-b701-720ef58f7aa5" returned: 0 in 0.447s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0d749a34-16dc-47df-99cb-197699c20897 tempest-VolumesTestJSON-311822292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1b070237-0d00-47c9-b701-720ef58f7aa5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:04 devstack sudo[89533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1b070237-0d00-47c9-b701-720ef58f7aa5
Nov 05 15:05:04 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:05 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0d749a34-16dc-47df-99cb-197699c20897 tempest-VolumesTestJSON-311822292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1b070237-0d00-47c9-b701-720ef58f7aa5" returned: 0 in 0.379s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0d749a34-16dc-47df-99cb-197699c20897 tempest-VolumesTestJSON-311822292 None] Lock "cinder-quobyte-1b070237-0d00-47c9-b701-720ef58f7aa5" released by "delete_volume" :: held 0.876s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:05:05 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-0d749a34-16dc-47df-99cb-197699c20897 tempest-VolumesTestJSON-311822292 None] Created reservations ['d91bf50c-9e0b-4726-b97c-356f45566d9c', '9e16c35a-3212-4a35-a006-8a96e4c54026', '786b03ff-35b4-4483-bad4-2fd259ca8dfd', '58664dcd-9313-4c12-9195-0f411de3a146'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:05:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0d749a34-16dc-47df-99cb-197699c20897 tempest-VolumesTestJSON-311822292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0d749a34-16dc-47df-99cb-197699c20897 tempest-VolumesTestJSON-311822292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0d749a34-16dc-47df-99cb-197699c20897 tempest-VolumesTestJSON-311822292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:05:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0d749a34-16dc-47df-99cb-197699c20897 tempest-VolumesTestJSON-311822292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:05:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0d749a34-16dc-47df-99cb-197699c20897 tempest-VolumesTestJSON-311822292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0d749a34-16dc-47df-99cb-197699c20897 tempest-VolumesTestJSON-311822292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:05 devstack sudo[89539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:05:05 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-099c055a-614f-4216-ac81-b2cf3e3e9848 tempest-VolumesTestJSON-311822292 None] Acquiring lock "cinder-c21eb34a-d4ed-462f-8f03-f505699335dc-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:05:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-099c055a-614f-4216-ac81-b2cf3e3e9848 tempest-VolumesTestJSON-311822292 None] Lock "cinder-c21eb34a-d4ed-462f-8f03-f505699335dc-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:05:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-099c055a-614f-4216-ac81-b2cf3e3e9848 tempest-VolumesTestJSON-311822292 None] Acquiring lock "cinder-quobyte-c21eb34a-d4ed-462f-8f03-f505699335dc" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:05:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-099c055a-614f-4216-ac81-b2cf3e3e9848 tempest-VolumesTestJSON-311822292 None] Lock "cinder-quobyte-c21eb34a-d4ed-462f-8f03-f505699335dc" acquired by "delete_volume" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:05:05 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7562a57-9ad3-4e5b-bab5-be7f3d2baed8]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:05:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-099c055a-614f-4216-ac81-b2cf3e3e9848 tempest-VolumesTestJSON-311822292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c21eb34a-d4ed-462f-8f03-f505699335dc {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:06 devstack sudo[89549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c21eb34a-d4ed-462f-8f03-f505699335dc
Nov 05 15:05:06 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-63233098-ba95-4196-b380-b9220e504350 req-62de13de-a4e9-4a75-b64c-669999df0ed5 tempest-DeleteServersTestJSON-2067802414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-63233098-ba95-4196-b380-b9220e504350 req-62de13de-a4e9-4a75-b64c-669999df0ed5 tempest-DeleteServersTestJSON-2067802414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-63233098-ba95-4196-b380-b9220e504350 req-62de13de-a4e9-4a75-b64c-669999df0ed5 tempest-DeleteServersTestJSON-2067802414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:06 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0d749a34-16dc-47df-99cb-197699c20897 tempest-VolumesTestJSON-311822292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.537s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:06 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-0d749a34-16dc-47df-99cb-197699c20897 tempest-VolumesTestJSON-311822292 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:05:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0d749a34-16dc-47df-99cb-197699c20897 tempest-VolumesTestJSON-311822292 None] Deleted volume successfully.
Nov 05 15:05:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-63233098-ba95-4196-b380-b9220e504350 req-62de13de-a4e9-4a75-b64c-669999df0ed5 tempest-DeleteServersTestJSON-2067802414 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628', 'name': 'volume-c01cab4f-ed4b-45f8-856d-18cd1b01ca95', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8befcdee-467e-4056-84e1-e7eed6fe5177', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 15:05:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0d749a34-16dc-47df-99cb-197699c20897 tempest-VolumesTestJSON-311822292 None] Lock "cinder-1b070237-0d00-47c9-b701-720ef58f7aa5-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:05:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-63233098-ba95-4196-b380-b9220e504350 req-62de13de-a4e9-4a75-b64c-669999df0ed5 tempest-DeleteServersTestJSON-2067802414 None] attachment_update completed successfully.
Nov 05 15:05:06 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-099c055a-614f-4216-ac81-b2cf3e3e9848 tempest-VolumesTestJSON-311822292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c21eb34a-d4ed-462f-8f03-f505699335dc" returned: 0 in 0.518s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-099c055a-614f-4216-ac81-b2cf3e3e9848 tempest-VolumesTestJSON-311822292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c21eb34a-d4ed-462f-8f03-f505699335dc {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:06 devstack sudo[89579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c21eb34a-d4ed-462f-8f03-f505699335dc
Nov 05 15:05:06 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:06 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-099c055a-614f-4216-ac81-b2cf3e3e9848 tempest-VolumesTestJSON-311822292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c21eb34a-d4ed-462f-8f03-f505699335dc" returned: 0 in 0.376s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-099c055a-614f-4216-ac81-b2cf3e3e9848 tempest-VolumesTestJSON-311822292 None] Lock "cinder-quobyte-c21eb34a-d4ed-462f-8f03-f505699335dc" released by "delete_volume" :: held 0.960s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:05:06 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-099c055a-614f-4216-ac81-b2cf3e3e9848 tempest-VolumesTestJSON-311822292 None] Created reservations ['e84eec5c-a130-41ba-a476-077aaada0b06', '330dca26-6db3-46da-96b5-60c2617c17af', 'c1e03d61-65ac-4420-b43d-d7d83e068bc0', '64d9008d-ad1e-4104-9702-0a01e68ab9c6'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:05:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-099c055a-614f-4216-ac81-b2cf3e3e9848 tempest-VolumesTestJSON-311822292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-099c055a-614f-4216-ac81-b2cf3e3e9848 tempest-VolumesTestJSON-311822292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-099c055a-614f-4216-ac81-b2cf3e3e9848 tempest-VolumesTestJSON-311822292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:05:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-099c055a-614f-4216-ac81-b2cf3e3e9848 tempest-VolumesTestJSON-311822292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:05:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-099c055a-614f-4216-ac81-b2cf3e3e9848 tempest-VolumesTestJSON-311822292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-099c055a-614f-4216-ac81-b2cf3e3e9848 tempest-VolumesTestJSON-311822292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:07 devstack sudo[89975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:05:07 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:07 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-099c055a-614f-4216-ac81-b2cf3e3e9848 tempest-VolumesTestJSON-311822292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.358s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:07 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-099c055a-614f-4216-ac81-b2cf3e3e9848 tempest-VolumesTestJSON-311822292 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:05:07 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-099c055a-614f-4216-ac81-b2cf3e3e9848 tempest-VolumesTestJSON-311822292 None] Deleted volume successfully.
Nov 05 15:05:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-099c055a-614f-4216-ac81-b2cf3e3e9848 tempest-VolumesTestJSON-311822292 None] Lock "cinder-c21eb34a-d4ed-462f-8f03-f505699335dc-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:05:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ac285b78-d654-4f8c-b886-97a731d1e86c tempest-VolumesTestJSON-311822292 None] Acquiring lock "cinder-3febb632-9a03-4c3e-8f45-b69f10ab2a6a-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:05:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ac285b78-d654-4f8c-b886-97a731d1e86c tempest-VolumesTestJSON-311822292 None] Lock "cinder-3febb632-9a03-4c3e-8f45-b69f10ab2a6a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:05:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ac285b78-d654-4f8c-b886-97a731d1e86c tempest-VolumesTestJSON-311822292 None] Acquiring lock "cinder-quobyte-3febb632-9a03-4c3e-8f45-b69f10ab2a6a" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:05:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ac285b78-d654-4f8c-b886-97a731d1e86c tempest-VolumesTestJSON-311822292 None] Lock "cinder-quobyte-3febb632-9a03-4c3e-8f45-b69f10ab2a6a" acquired by "delete_volume" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:05:08 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d617d3-a0fe-4344-a996-91e63ab05331]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:05:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ac285b78-d654-4f8c-b886-97a731d1e86c tempest-VolumesTestJSON-311822292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3febb632-9a03-4c3e-8f45-b69f10ab2a6a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:08 devstack sudo[89983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3febb632-9a03-4c3e-8f45-b69f10ab2a6a
Nov 05 15:05:08 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:09 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ac285b78-d654-4f8c-b886-97a731d1e86c tempest-VolumesTestJSON-311822292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3febb632-9a03-4c3e-8f45-b69f10ab2a6a" returned: 0 in 0.713s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ac285b78-d654-4f8c-b886-97a731d1e86c tempest-VolumesTestJSON-311822292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3febb632-9a03-4c3e-8f45-b69f10ab2a6a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:09 devstack sudo[90031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3febb632-9a03-4c3e-8f45-b69f10ab2a6a
Nov 05 15:05:09 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:09 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ac285b78-d654-4f8c-b886-97a731d1e86c tempest-VolumesTestJSON-311822292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3febb632-9a03-4c3e-8f45-b69f10ab2a6a" returned: 0 in 0.381s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ac285b78-d654-4f8c-b886-97a731d1e86c tempest-VolumesTestJSON-311822292 None] Lock "cinder-quobyte-3febb632-9a03-4c3e-8f45-b69f10ab2a6a" released by "delete_volume" :: held 1.205s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-ac285b78-d654-4f8c-b886-97a731d1e86c tempest-VolumesTestJSON-311822292 None] Created reservations ['03bd7889-4035-4f13-ab5b-47d07ee6946f', '344178f0-4fda-4766-81aa-eec1fe9493dd', '9408dcc0-bc80-44b7-9f88-610702446a01', 'd114f8ef-9b29-4106-9afd-622f0a215437'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ac285b78-d654-4f8c-b886-97a731d1e86c tempest-VolumesTestJSON-311822292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ac285b78-d654-4f8c-b886-97a731d1e86c tempest-VolumesTestJSON-311822292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ac285b78-d654-4f8c-b886-97a731d1e86c tempest-VolumesTestJSON-311822292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ac285b78-d654-4f8c-b886-97a731d1e86c tempest-VolumesTestJSON-311822292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ac285b78-d654-4f8c-b886-97a731d1e86c tempest-VolumesTestJSON-311822292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ac285b78-d654-4f8c-b886-97a731d1e86c tempest-VolumesTestJSON-311822292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:09 devstack sudo[90074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:05:09 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Flow 'volume_create_manager' (1f991f4c-c3a0-4c28-a182-cfa62441c7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace4bfba-a7e4-47a6-840c-6fadadc47753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace4bfba-a7e4-47a6-840c-6fadadc47753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-521285343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91989d49-c84f-4898-b4e6-706228ac19c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a47b61f05840fb8c946db2617d4869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:10Z,use_quota=True,user_id='575c9bc5765e4c1fbaa7650c1aa8898b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29cbff3f-9338-4566-ad37-e3405743c0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29cbff3f-9338-4566-ad37-e3405743c0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb47116-b94c-433d-b870-f8cacad68bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb47116-b94c-433d-b870-f8cacad68bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91989d49-c84f-4898-b4e6-706228ac19c0', 'volume_name': 'volume-91989d49-c84f-4898-b4e6-706228ac19c0', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e36e6eee-a46b-424a-9f2a-e499c648b944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e36e6eee-a46b-424a-9f2a-e499c648b944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23cf6527-7a1a-4d58-bc51-88cc21f91af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:09 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Volume 91989d49-c84f-4898-b4e6-706228ac19c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91989d49-c84f-4898-b4e6-706228ac19c0', 'volume_size': 1}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-521285343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91989d49-c84f-4898-b4e6-706228ac19c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a47b61f05840fb8c946db2617d4869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:10Z,use_quota=True,user_id='575c9bc5765e4c1fbaa7650c1aa8898b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Creating volume 91989d49-c84f-4898-b4e6-706228ac19c0 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:05:09 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:05:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-91989d49-c84f-4898-b4e6-706228ac19c0 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:09 devstack sudo[90076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-91989d49-c84f-4898-b4e6-706228ac19c0 1073741824
Nov 05 15:05:09 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:10 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ac285b78-d654-4f8c-b886-97a731d1e86c tempest-VolumesTestJSON-311822292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.437s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:10 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-ac285b78-d654-4f8c-b886-97a731d1e86c tempest-VolumesTestJSON-311822292 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:05:10 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ac285b78-d654-4f8c-b886-97a731d1e86c tempest-VolumesTestJSON-311822292 None] Deleted volume successfully.
Nov 05 15:05:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ac285b78-d654-4f8c-b886-97a731d1e86c tempest-VolumesTestJSON-311822292 None] Lock "cinder-3febb632-9a03-4c3e-8f45-b69f10ab2a6a-delete_volume" released by "delete_volume" :: held 2.145s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:05:10 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-06a36b62-ebb8-4080-8cd8-f3153bd6a8eb req-1118441d-b4ca-4c70-9bc6-5c7ca96096e3 tempest-DeleteServersTestJSON-2067802414 None] Terminate volume connection completed successfully.
Nov 05 15:05:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-06a36b62-ebb8-4080-8cd8-f3153bd6a8eb req-1118441d-b4ca-4c70-9bc6-5c7ca96096e3 tempest-DeleteServersTestJSON-2067802414 None] Deleting attachment 8befcdee-467e-4056-84e1-e7eed6fe5177. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 15:05:10 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-91989d49-c84f-4898-b4e6-706228ac19c0 1073741824" returned: 0 in 0.808s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-91989d49-c84f-4898-b4e6-706228ac19c0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:10 devstack sudo[90087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-91989d49-c84f-4898-b4e6-706228ac19c0
Nov 05 15:05:10 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:11 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-91989d49-c84f-4898-b4e6-706228ac19c0" returned: 0 in 0.449s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:05:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23cf6527-7a1a-4d58-bc51-88cc21f91af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91989d49-c84f-4898-b4e6-706228ac19c0', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5361b640-7894-4f4e-8c70-07ac03f511a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:11 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Volume volume-91989d49-c84f-4898-b4e6-706228ac19c0 (91989d49-c84f-4898-b4e6-706228ac19c0): created successfully
Nov 05 15:05:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5361b640-7894-4f4e-8c70-07ac03f511a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Flow 'volume_create_manager' (1f991f4c-c3a0-4c28-a182-cfa62441c7c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:05:11 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-aa680c0f-5231-4e09-8f26-1bc249fbc70e tempest-ServerActionsTestOtherA-844328353 None] Created volume successfully.
Nov 05 15:05:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-875ff8f1-9da5-454e-b9a0-cc8de8511b76 tempest-DeleteServersTestJSON-2067802414 None] Acquiring lock "cinder-c01cab4f-ed4b-45f8-856d-18cd1b01ca95-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:05:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-875ff8f1-9da5-454e-b9a0-cc8de8511b76 tempest-DeleteServersTestJSON-2067802414 None] Lock "cinder-c01cab4f-ed4b-45f8-856d-18cd1b01ca95-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:05:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-875ff8f1-9da5-454e-b9a0-cc8de8511b76 tempest-DeleteServersTestJSON-2067802414 None] Acquiring lock "cinder-quobyte-c01cab4f-ed4b-45f8-856d-18cd1b01ca95" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:05:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-875ff8f1-9da5-454e-b9a0-cc8de8511b76 tempest-DeleteServersTestJSON-2067802414 None] Lock "cinder-quobyte-c01cab4f-ed4b-45f8-856d-18cd1b01ca95" acquired by "delete_volume" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:05:12 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[55df176a-797b-41e1-b7a3-bc569a730ee0]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:05:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-875ff8f1-9da5-454e-b9a0-cc8de8511b76 tempest-DeleteServersTestJSON-2067802414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c01cab4f-ed4b-45f8-856d-18cd1b01ca95 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:12 devstack sudo[90092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c01cab4f-ed4b-45f8-856d-18cd1b01ca95
Nov 05 15:05:12 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:12 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-875ff8f1-9da5-454e-b9a0-cc8de8511b76 tempest-DeleteServersTestJSON-2067802414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c01cab4f-ed4b-45f8-856d-18cd1b01ca95" returned: 0 in 0.448s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-875ff8f1-9da5-454e-b9a0-cc8de8511b76 tempest-DeleteServersTestJSON-2067802414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c01cab4f-ed4b-45f8-856d-18cd1b01ca95 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:12 devstack sudo[90097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c01cab4f-ed4b-45f8-856d-18cd1b01ca95
Nov 05 15:05:12 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:12 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-875ff8f1-9da5-454e-b9a0-cc8de8511b76 tempest-DeleteServersTestJSON-2067802414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c01cab4f-ed4b-45f8-856d-18cd1b01ca95" returned: 0 in 0.260s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-875ff8f1-9da5-454e-b9a0-cc8de8511b76 tempest-DeleteServersTestJSON-2067802414 None] Lock "cinder-quobyte-c01cab4f-ed4b-45f8-856d-18cd1b01ca95" released by "delete_volume" :: held 0.761s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:05:12 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-875ff8f1-9da5-454e-b9a0-cc8de8511b76 tempest-DeleteServersTestJSON-2067802414 None] Created reservations ['bccb4678-f62d-4876-96fe-4387e9f6e2f5', '23f94285-ab13-4954-ac89-96d0ab7939ec', '70ced80c-0681-4588-8363-e066b9328339', '4cc556b3-9f4f-4ec8-97b9-8218958540ea'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:05:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-875ff8f1-9da5-454e-b9a0-cc8de8511b76 tempest-DeleteServersTestJSON-2067802414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-875ff8f1-9da5-454e-b9a0-cc8de8511b76 tempest-DeleteServersTestJSON-2067802414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-875ff8f1-9da5-454e-b9a0-cc8de8511b76 tempest-DeleteServersTestJSON-2067802414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:05:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-875ff8f1-9da5-454e-b9a0-cc8de8511b76 tempest-DeleteServersTestJSON-2067802414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:05:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-875ff8f1-9da5-454e-b9a0-cc8de8511b76 tempest-DeleteServersTestJSON-2067802414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-875ff8f1-9da5-454e-b9a0-cc8de8511b76 tempest-DeleteServersTestJSON-2067802414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:13 devstack sudo[90100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:05:13 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:13 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-875ff8f1-9da5-454e-b9a0-cc8de8511b76 tempest-DeleteServersTestJSON-2067802414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.344s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:13 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-875ff8f1-9da5-454e-b9a0-cc8de8511b76 tempest-DeleteServersTestJSON-2067802414 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:05:13 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-875ff8f1-9da5-454e-b9a0-cc8de8511b76 tempest-DeleteServersTestJSON-2067802414 None] Deleted volume successfully.
Nov 05 15:05:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-875ff8f1-9da5-454e-b9a0-cc8de8511b76 tempest-DeleteServersTestJSON-2067802414 None] Lock "cinder-c01cab4f-ed4b-45f8-856d-18cd1b01ca95-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:05:16 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1212819a-cf8c-4af8-95c9-f1618fdf9bb2 tempest-GroupSnapshotsTest-714654516 None] Group tempest-GroupSnapshotsTest-Group-1463254723: creating
Nov 05 15:05:16 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1212819a-cf8c-4af8-95c9-f1618fdf9bb2 tempest-GroupSnapshotsTest-714654516 None] Group tempest-GroupSnapshotsTest-Group-1463254723: created successfully
Nov 05 15:05:16 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1212819a-cf8c-4af8-95c9-f1618fdf9bb2 tempest-GroupSnapshotsTest-714654516 None] Create group completed successfully.
Nov 05 15:05:18 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:05:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Flow 'volume_create_manager' (17a339c0-8caf-45b3-9daa-786be5b1f439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:05:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33662e7b-1f71-42fe-9593-c4e820e8357b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33662e7b-1f71-42fe-9593-c4e820e8357b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2086467972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=da373e02-d468-44c9-bcbb-4781b31529bb,host='devstack@QuobyteHD#QuobyteHD',id=3c80c139-2455-4eb6-bf99-375eec55dbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f4ab8cf4a14c5ab7c199929069a2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:19Z,use_quota=True,user_id='99bdc2d732cb4c9f9c1fc3209edb1317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c90ea995-fc78-463b-986b-d8d1b1af7ac0),volume_type_id=c90ea995-fc78-463b-986b-d8d1b1af7ac0)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d53374c7-c28b-4cad-a4f0-3ecc98ca7958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d53374c7-c28b-4cad-a4f0-3ecc98ca7958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28b46e8-ddda-4a3b-bab8-85b1d69e743f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28b46e8-ddda-4a3b-bab8-85b1d69e743f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c80c139-2455-4eb6-bf99-375eec55dbf3', 'volume_name': 'volume-3c80c139-2455-4eb6-bf99-375eec55dbf3', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31071fae-5978-415a-b77f-485bd263c5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31071fae-5978-415a-b77f-485bd263c5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00cbdb1-3478-4e78-90dc-8e3830e2bb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:18 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Volume 3c80c139-2455-4eb6-bf99-375eec55dbf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c80c139-2455-4eb6-bf99-375eec55dbf3', 'volume_size': 1}
Nov 05 15:05:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=da373e02-d468-44c9-bcbb-4781b31529bb,created_at=2026-11-05T14:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2086467972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=da373e02-d468-44c9-bcbb-4781b31529bb,host='devstack@QuobyteHD#QuobyteHD',id=3c80c139-2455-4eb6-bf99-375eec55dbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f4ab8cf4a14c5ab7c199929069a2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:19Z,use_quota=True,user_id='99bdc2d732cb4c9f9c1fc3209edb1317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c90ea995-fc78-463b-986b-d8d1b1af7ac0),volume_type_id=c90ea995-fc78-463b-986b-d8d1b1af7ac0)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:05:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Creating volume 3c80c139-2455-4eb6-bf99-375eec55dbf3 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:05:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:05:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:05:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:05:18 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:05:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:19 devstack sudo[90115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3 1073741824
Nov 05 15:05:19 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:19 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3 1073741824" returned: 0 in 0.680s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:19 devstack sudo[90125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3
Nov 05 15:05:19 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:20 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3" returned: 0 in 0.326s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:05:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00cbdb1-3478-4e78-90dc-8e3830e2bb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c80c139-2455-4eb6-bf99-375eec55dbf3', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69fad284-b194-4f63-b139-03a2b7513275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:20 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Volume volume-3c80c139-2455-4eb6-bf99-375eec55dbf3 (3c80c139-2455-4eb6-bf99-375eec55dbf3): created successfully
Nov 05 15:05:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69fad284-b194-4f63-b139-03a2b7513275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Flow 'volume_create_manager' (17a339c0-8caf-45b3-9daa-786be5b1f439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:05:20 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1af19d14-ead8-4de4-afc2-5a942767ec95 tempest-GroupSnapshotsTest-714654516 None] Created volume successfully.
Nov 05 15:05:21 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-92272c0e-35b3-4308-9f9f-318032312bfe tempest-GroupSnapshotsTest-714654516 None] GroupSnapshot 3df99c0e-899c-452f-bf8f-875e495af3f9: creating.
Nov 05 15:05:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92272c0e-35b3-4308-9f9f-318032312bfe tempest-GroupSnapshotsTest-714654516 None] Group snapshot 3df99c0e-899c-452f-bf8f-875e495af3f9: creating. {{(pid=87150) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 15:05:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-92272c0e-35b3-4308-9f9f-318032312bfe tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-92272c0e-35b3-4308-9f9f-318032312bfe tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-92272c0e-35b3-4308-9f9f-318032312bfe tempest-GroupSnapshotsTest-714654516 None] Creating offline snapshot fc7cd708-f713-400c-bacf-9debbc39dc2a of volume 3c80c139-2455-4eb6-bf99-375eec55dbf3 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:05:21 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff02e69-19ce-4135-bbbb-bd3092c9757a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:05:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92272c0e-35b3-4308-9f9f-318032312bfe tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:22 devstack sudo[90147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3
Nov 05 15:05:22 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:22 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92272c0e-35b3-4308-9f9f-318032312bfe tempest-GroupSnapshotsTest-714654516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3" returned: 0 in 0.613s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92272c0e-35b3-4308-9f9f-318032312bfe tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.fc7cd708-f713-400c-bacf-9debbc39dc2a 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:22 devstack sudo[90157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.fc7cd708-f713-400c-bacf-9debbc39dc2a 1G
Nov 05 15:05:22 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:23 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92272c0e-35b3-4308-9f9f-318032312bfe tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.fc7cd708-f713-400c-bacf-9debbc39dc2a 1G" returned: 0 in 0.627s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92272c0e-35b3-4308-9f9f-318032312bfe tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c80c139-2455-4eb6-bf99-375eec55dbf3 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.fc7cd708-f713-400c-bacf-9debbc39dc2a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:23 devstack sudo[90171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c80c139-2455-4eb6-bf99-375eec55dbf3 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.fc7cd708-f713-400c-bacf-9debbc39dc2a
Nov 05 15:05:23 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:23 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92272c0e-35b3-4308-9f9f-318032312bfe tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c80c139-2455-4eb6-bf99-375eec55dbf3 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.fc7cd708-f713-400c-bacf-9debbc39dc2a" returned: 0 in 0.382s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:23 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-92272c0e-35b3-4308-9f9f-318032312bfe tempest-GroupSnapshotsTest-714654516 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.fc7cd708-f713-400c-bacf-9debbc39dc2a is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 15:05:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92272c0e-35b3-4308-9f9f-318032312bfe tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.fc7cd708-f713-400c-bacf-9debbc39dc2a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:23 devstack sudo[90177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.fc7cd708-f713-400c-bacf-9debbc39dc2a
Nov 05 15:05:23 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:23 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92272c0e-35b3-4308-9f9f-318032312bfe tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.fc7cd708-f713-400c-bacf-9debbc39dc2a" returned: 0 in 0.272s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92272c0e-35b3-4308-9f9f-318032312bfe tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:23 devstack sudo[90180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.info
Nov 05 15:05:23 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:24 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92272c0e-35b3-4308-9f9f-318032312bfe tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.info" returned: 0 in 0.290s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:24 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-92272c0e-35b3-4308-9f9f-318032312bfe tempest-GroupSnapshotsTest-714654516 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 15:05:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92272c0e-35b3-4308-9f9f-318032312bfe tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:24 devstack sudo[90183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.info
Nov 05 15:05:24 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:24 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92272c0e-35b3-4308-9f9f-318032312bfe tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.info" returned: 0 in 0.281s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-92272c0e-35b3-4308-9f9f-318032312bfe tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.585s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:24 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-92272c0e-35b3-4308-9f9f-318032312bfe tempest-GroupSnapshotsTest-714654516 None] group_snapshot 3df99c0e-899c-452f-bf8f-875e495af3f9: created successfully
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "cinder-quobyte-fc7cd708-f713-400c-bacf-9debbc39dc2a-d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839" by "_create_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-fc7cd708-f713-400c-bacf-9debbc39dc2a-d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Creating volume d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839 from snapshot fc7cd708-f713-400c-bacf-9debbc39dc2a {{(pid=87150) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "cinder-quobyte-d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839" by "_copy_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] snapshot: fc7cd708-f713-400c-bacf-9debbc39dc2a, volume: d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839,  {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[555b154d-864f-451f-b6b0-0bc81b876328]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.fc7cd708-f713-400c-bacf-9debbc39dc2a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:26 devstack sudo[90186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.fc7cd708-f713-400c-bacf-9debbc39dc2a
Nov 05 15:05:26 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:26 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.fc7cd708-f713-400c-bacf-9debbc39dc2a" returned: 0 in 0.428s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c80c139-2455-4eb6-bf99-375eec55dbf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa727e8-3160-4608-bfbb-99669a58770e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:05:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:26 devstack sudo[90191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3
Nov 05 15:05:26 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:27 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3" returned: 0 in 0.416s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3 {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 15:05:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Creating direct copy from snapshot {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 15:05:27 devstack cinder-volume[87150]: DEBUG cinder.utils [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Path /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839 not found in is_blk_device check {{(pid=87150) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 15:05:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:27 devstack sudo[90196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839
Nov 05 15:05:27 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:36 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=65,cinder:UPDATE=72,cinder:INSERT=19,cinder:DELETE=9 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:05:36 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=73,cinder:UPDATE=78,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:05:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:05:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:05:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:05:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:37 devstack sudo[90269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:05:37 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:38 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.869s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:38 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:05:38 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:05:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread count: 8 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 15:05:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread info: [<_MainThread(MainThread, started 136317437956224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136317326340928)>, <Thread(Thread-3 (stat_writer), started daemon 136317326487936)>, <Thread(Rabbit-heartbeat, started daemon 136317321464000)>, <Thread(Thread-5 (_runner), started daemon 136317321550592)>, <Thread(Thread-7 (_runner), started daemon 136317321658496)>, <Thread(fd_logger, started daemon 136317319612992)>, <Thread(privsep_reader, started daemon 136317319622400)>] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 15:05:38 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839" returned: 0 in 11.245s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:38 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Image conversion details: src /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3, size 1024.00 MB, duration 11.25 sec, destination /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:05:38 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Converted 1024.00 MB image at 91.05 MB/s
Nov 05 15:05:38 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 15:05:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:38 devstack sudo[90273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839
Nov 05 15:05:38 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:38 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839" returned: 0 in 0.350s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839" released by "_copy_volume_from_snapshot" :: held 12.575s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:05:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-fc7cd708-f713-400c-bacf-9debbc39dc2a-d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839" released by "_create_volume_from_snapshot" :: held 12.697s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:05:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.721s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:39 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-15b9ad44-7ba6-4565-b9d2-42a024615b66 tempest-GroupSnapshotsTest-714654516 None] Create group from source-snapshot-3df99c0e-899c-452f-bf8f-875e495af3f9 completed successfully.
Nov 05 15:05:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7ecff6a1-e812-4474-9511-f3839407088f tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "cinder-quobyte-d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:05:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7ecff6a1-e812-4474-9511-f3839407088f tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839" acquired by "delete_volume" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:05:41 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[65358f43-fc4d-4f25-9a73-72629fa79907]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:05:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7ecff6a1-e812-4474-9511-f3839407088f tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:41 devstack sudo[90279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839
Nov 05 15:05:41 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:42 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7ecff6a1-e812-4474-9511-f3839407088f tempest-GroupSnapshotsTest-714654516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839" returned: 0 in 0.824s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7ecff6a1-e812-4474-9511-f3839407088f tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:42 devstack sudo[90284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839
Nov 05 15:05:42 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:42 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7ecff6a1-e812-4474-9511-f3839407088f tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839" returned: 0 in 0.452s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7ecff6a1-e812-4474-9511-f3839407088f tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-d9dbe0e8-baa5-4de2-9ae4-b6f9e6a4d839" released by "delete_volume" :: held 1.391s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:05:42 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-7ecff6a1-e812-4474-9511-f3839407088f tempest-GroupSnapshotsTest-714654516 None] Created reservations ['5026bdd4-1df7-4e7c-a4aa-05bb6df8e668'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:05:42 devstack cinder-volume[87150]: WARNING cinder.quota [None req-7ecff6a1-e812-4474-9511-f3839407088f tempest-GroupSnapshotsTest-714654516 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1474898993 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1474898993, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:05:42 devstack cinder-volume[87150]: WARNING cinder.quota [None req-7ecff6a1-e812-4474-9511-f3839407088f tempest-GroupSnapshotsTest-714654516 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1474898993 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1474898993, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:05:42 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-7ecff6a1-e812-4474-9511-f3839407088f tempest-GroupSnapshotsTest-714654516 None] Created reservations ['83faed8f-588f-4d14-bf76-12684c0d122b', 'f57557a5-462f-4601-81de-77fd591e5543', '7b34c733-784d-4bb4-9b5f-441c39aecc83', '72b701dd-afa0-4273-9a95-e249722ab0ef'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:05:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7ecff6a1-e812-4474-9511-f3839407088f tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7ecff6a1-e812-4474-9511-f3839407088f tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7ecff6a1-e812-4474-9511-f3839407088f tempest-GroupSnapshotsTest-714654516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:05:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7ecff6a1-e812-4474-9511-f3839407088f tempest-GroupSnapshotsTest-714654516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:05:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7ecff6a1-e812-4474-9511-f3839407088f tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7ecff6a1-e812-4474-9511-f3839407088f tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:43 devstack sudo[90287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:05:43 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:43 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7ecff6a1-e812-4474-9511-f3839407088f tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.483s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:43 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-7ecff6a1-e812-4474-9511-f3839407088f tempest-GroupSnapshotsTest-714654516 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:05:43 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7ecff6a1-e812-4474-9511-f3839407088f tempest-GroupSnapshotsTest-714654516 None] Delete group completed successfully.
Nov 05 15:05:44 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-47317f45-ddb5-49bd-ae38-75262e44293b tempest-GroupSnapshotsTest-714654516 None] group_snapshot 3df99c0e-899c-452f-bf8f-875e495af3f9: deleting
Nov 05 15:05:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47317f45-ddb5-49bd-ae38-75262e44293b tempest-GroupSnapshotsTest-714654516 None] group_snapshot 3df99c0e-899c-452f-bf8f-875e495af3f9: deleting {{(pid=87150) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 15:05:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-47317f45-ddb5-49bd-ae38-75262e44293b tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "cinder-quobyte-3c80c139-2455-4eb6-bf99-375eec55dbf3" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:05:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-47317f45-ddb5-49bd-ae38-75262e44293b tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-3c80c139-2455-4eb6-bf99-375eec55dbf3" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:05:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-47317f45-ddb5-49bd-ae38-75262e44293b tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "cinder-quobyte-fc7cd708-f713-400c-bacf-9debbc39dc2a" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:05:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-47317f45-ddb5-49bd-ae38-75262e44293b tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-fc7cd708-f713-400c-bacf-9debbc39dc2a" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:05:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-47317f45-ddb5-49bd-ae38-75262e44293b tempest-GroupSnapshotsTest-714654516 None] Deleting offline snapshot fc7cd708-f713-400c-bacf-9debbc39dc2a of volume 3c80c139-2455-4eb6-bf99-375eec55dbf3 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:05:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-47317f45-ddb5-49bd-ae38-75262e44293b tempest-GroupSnapshotsTest-714654516 None] snapshot_file for this snap is: volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.fc7cd708-f713-400c-bacf-9debbc39dc2a {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:05:44 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[809df8b2-5d0e-46eb-b5ac-c85448d923c3]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:05:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47317f45-ddb5-49bd-ae38-75262e44293b tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.fc7cd708-f713-400c-bacf-9debbc39dc2a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:45 devstack sudo[90334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.fc7cd708-f713-400c-bacf-9debbc39dc2a
Nov 05 15:05:45 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:45 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47317f45-ddb5-49bd-ae38-75262e44293b tempest-GroupSnapshotsTest-714654516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.fc7cd708-f713-400c-bacf-9debbc39dc2a" returned: 0 in 0.761s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-47317f45-ddb5-49bd-ae38-75262e44293b tempest-GroupSnapshotsTest-714654516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c80c139-2455-4eb6-bf99-375eec55dbf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:05:45 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[239988a4-9deb-44ee-ae53-0ded784c883d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:05:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47317f45-ddb5-49bd-ae38-75262e44293b tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:45 devstack sudo[90341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3
Nov 05 15:05:45 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:46 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47317f45-ddb5-49bd-ae38-75262e44293b tempest-GroupSnapshotsTest-714654516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3" returned: 0 in 0.792s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47317f45-ddb5-49bd-ae38-75262e44293b tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.fc7cd708-f713-400c-bacf-9debbc39dc2a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:46 devstack sudo[90347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.fc7cd708-f713-400c-bacf-9debbc39dc2a
Nov 05 15:05:46 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:46 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47317f45-ddb5-49bd-ae38-75262e44293b tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.fc7cd708-f713-400c-bacf-9debbc39dc2a" returned: 0 in 0.518s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47317f45-ddb5-49bd-ae38-75262e44293b tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.fc7cd708-f713-400c-bacf-9debbc39dc2a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:46 devstack sudo[90365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.fc7cd708-f713-400c-bacf-9debbc39dc2a
Nov 05 15:05:46 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:47 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47317f45-ddb5-49bd-ae38-75262e44293b tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3.fc7cd708-f713-400c-bacf-9debbc39dc2a" returned: 0 in 0.329s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-47317f45-ddb5-49bd-ae38-75262e44293b tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-fc7cd708-f713-400c-bacf-9debbc39dc2a" released by "_delete_snapshot" :: held 2.625s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:05:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-47317f45-ddb5-49bd-ae38-75262e44293b tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-3c80c139-2455-4eb6-bf99-375eec55dbf3" released by "delete_snapshot" :: held 2.695s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:05:47 devstack cinder-volume[87150]: WARNING cinder.quota [None req-47317f45-ddb5-49bd-ae38-75262e44293b tempest-GroupSnapshotsTest-714654516 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1474898993 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1474898993, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:05:47 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-47317f45-ddb5-49bd-ae38-75262e44293b tempest-GroupSnapshotsTest-714654516 None] Created reservations ['fab5e759-fff9-496e-b25d-d3f9810a51bf', 'e0d23026-2c9c-468d-958b-70c9da3cadd3', '2a3e9723-2aeb-4df9-b23a-84946ea1c05b', '6fca9369-b915-4139-a107-a05a95541acd'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:05:47 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-47317f45-ddb5-49bd-ae38-75262e44293b tempest-GroupSnapshotsTest-714654516 None] group_snapshot 3df99c0e-899c-452f-bf8f-875e495af3f9: deleted successfully
Nov 05 15:05:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6016b2f8-15e6-4f2b-8564-3b4593092288 tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "cinder-quobyte-3c80c139-2455-4eb6-bf99-375eec55dbf3" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:05:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6016b2f8-15e6-4f2b-8564-3b4593092288 tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-3c80c139-2455-4eb6-bf99-375eec55dbf3" acquired by "delete_volume" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:05:48 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed0d36c-aeac-4e34-a043-a76c49a6ca8d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:05:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6016b2f8-15e6-4f2b-8564-3b4593092288 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:48 devstack sudo[90379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3
Nov 05 15:05:48 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:49 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6016b2f8-15e6-4f2b-8564-3b4593092288 tempest-GroupSnapshotsTest-714654516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3" returned: 0 in 0.496s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6016b2f8-15e6-4f2b-8564-3b4593092288 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:49 devstack sudo[90386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3
Nov 05 15:05:49 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:49 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6016b2f8-15e6-4f2b-8564-3b4593092288 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3c80c139-2455-4eb6-bf99-375eec55dbf3" returned: 0 in 0.394s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6016b2f8-15e6-4f2b-8564-3b4593092288 tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-3c80c139-2455-4eb6-bf99-375eec55dbf3" released by "delete_volume" :: held 0.999s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:05:49 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-6016b2f8-15e6-4f2b-8564-3b4593092288 tempest-GroupSnapshotsTest-714654516 None] Created reservations ['20566596-ea74-40cb-bfb6-84da91f3b397'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:05:49 devstack cinder-volume[87150]: WARNING cinder.db.api [None req-6016b2f8-15e6-4f2b-8564-3b4593092288 tempest-GroupSnapshotsTest-714654516 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1474898993']
Nov 05 15:05:49 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-6016b2f8-15e6-4f2b-8564-3b4593092288 tempest-GroupSnapshotsTest-714654516 None] Created reservations ['a0e716b2-4dc2-4606-8fa4-29af90888291', '7f4466f0-1f78-47b6-a1cb-b9e184836ac8', '53ec0f28-d58b-4da3-9a7d-663197be6228', '67f7de8e-1ce9-4019-a927-3ebc0e7cd565'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:05:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6016b2f8-15e6-4f2b-8564-3b4593092288 tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6016b2f8-15e6-4f2b-8564-3b4593092288 tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6016b2f8-15e6-4f2b-8564-3b4593092288 tempest-GroupSnapshotsTest-714654516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:05:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6016b2f8-15e6-4f2b-8564-3b4593092288 tempest-GroupSnapshotsTest-714654516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:05:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6016b2f8-15e6-4f2b-8564-3b4593092288 tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6016b2f8-15e6-4f2b-8564-3b4593092288 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:50 devstack sudo[90394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:05:50 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:50 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6016b2f8-15e6-4f2b-8564-3b4593092288 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.341s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:50 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-6016b2f8-15e6-4f2b-8564-3b4593092288 tempest-GroupSnapshotsTest-714654516 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:05:50 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6016b2f8-15e6-4f2b-8564-3b4593092288 tempest-GroupSnapshotsTest-714654516 None] Delete group completed successfully.
Nov 05 15:05:52 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2517689d-c458-4639-9847-fed10595c6de tempest-GroupSnapshotsTest-714654516 None] Group tempest-GroupSnapshotsTest-Group-824025538: creating
Nov 05 15:05:52 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2517689d-c458-4639-9847-fed10595c6de tempest-GroupSnapshotsTest-714654516 None] Group tempest-GroupSnapshotsTest-Group-824025538: created successfully
Nov 05 15:05:52 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2517689d-c458-4639-9847-fed10595c6de tempest-GroupSnapshotsTest-714654516 None] Create group completed successfully.
Nov 05 15:05:55 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:05:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Flow 'volume_create_manager' (44262bc0-9069-49c6-b198-dd3eb52bfb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:05:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b145f717-0ad0-4cfe-a98a-943ce9eca210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b145f717-0ad0-4cfe-a98a-943ce9eca210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1970467723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=976371b1-2a8b-43fe-9691-c7daaf23e8de,host='devstack@QuobyteHD#QuobyteHD',id=6f95d4eb-5891-411d-80d2-ceedcae36bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f4ab8cf4a14c5ab7c199929069a2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:55Z,use_quota=True,user_id='99bdc2d732cb4c9f9c1fc3209edb1317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(321a6e62-23a5-4836-b0ff-a1666fa84c92),volume_type_id=321a6e62-23a5-4836-b0ff-a1666fa84c92)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e39bb1-ba4e-4ae1-8fea-4c05a5ac23c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e39bb1-ba4e-4ae1-8fea-4c05a5ac23c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f8d0dcc-df24-48e4-a4d8-5d681ed2bc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f8d0dcc-df24-48e4-a4d8-5d681ed2bc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f95d4eb-5891-411d-80d2-ceedcae36bd1', 'volume_name': 'volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ecf5e4-4287-419d-848d-60fe0ae86588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ecf5e4-4287-419d-848d-60fe0ae86588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297b949f-4649-454b-b57f-70529757f290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:55 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Volume 6f95d4eb-5891-411d-80d2-ceedcae36bd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1', 'volume_size': 1}
Nov 05 15:05:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=976371b1-2a8b-43fe-9691-c7daaf23e8de,created_at=2026-11-05T14:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1970467723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=976371b1-2a8b-43fe-9691-c7daaf23e8de,host='devstack@QuobyteHD#QuobyteHD',id=6f95d4eb-5891-411d-80d2-ceedcae36bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f4ab8cf4a14c5ab7c199929069a2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:55Z,use_quota=True,user_id='99bdc2d732cb4c9f9c1fc3209edb1317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(321a6e62-23a5-4836-b0ff-a1666fa84c92),volume_type_id=321a6e62-23a5-4836-b0ff-a1666fa84c92)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:05:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Creating volume 6f95d4eb-5891-411d-80d2-ceedcae36bd1 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:05:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:05:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:05:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:05:55 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:05:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:55 devstack sudo[90505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1 1073741824
Nov 05 15:05:55 devstack sudo[90505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:56 devstack sudo[90505]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1 1073741824" returned: 0 in 1.047s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:56 devstack sudo[90515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1
Nov 05 15:05:56 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:05:57 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root
Nov 05 15:05:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1" returned: 0 in 0.437s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:05:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:05:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297b949f-4649-454b-b57f-70529757f290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2287f68-5241-4adb-99db-127ba5197fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:57 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Volume volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1 (6f95d4eb-5891-411d-80d2-ceedcae36bd1): created successfully
Nov 05 15:05:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2287f68-5241-4adb-99db-127ba5197fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Flow 'volume_create_manager' (44262bc0-9069-49c6-b198-dd3eb52bfb75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:05:57 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-8c2d9382-8cbe-4631-9c90-042087763ec8 tempest-GroupSnapshotsTest-714654516 None] Created volume successfully.
Nov 05 15:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Flow 'volume_create_manager' (85f2fda9-558b-4dbf-bd51-133b95b7c7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e27ced-4c46-4b59-b8a1-da17cc716195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e27ced-4c46-4b59-b8a1-da17cc716195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2047872747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=976371b1-2a8b-43fe-9691-c7daaf23e8de,host='devstack@QuobyteHD#QuobyteHD',id=b14c7f17-5048-4cfd-be8e-de9534bbb3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f4ab8cf4a14c5ab7c199929069a2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:59Z,use_quota=True,user_id='99bdc2d732cb4c9f9c1fc3209edb1317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(321a6e62-23a5-4836-b0ff-a1666fa84c92),volume_type_id=321a6e62-23a5-4836-b0ff-a1666fa84c92)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d92286-c174-42f3-92ee-498512d35ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d92286-c174-42f3-92ee-498512d35ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc724ab-e9da-418b-9793-c95312df4fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc724ab-e9da-418b-9793-c95312df4fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b14c7f17-5048-4cfd-be8e-de9534bbb3a3', 'volume_name': 'volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33434be2-348e-4839-a077-05c6cb5fa812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33434be2-348e-4839-a077-05c6cb5fa812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76201e2-7c21-4ad6-babb-84ef95e6864c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:05:59 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Volume b14c7f17-5048-4cfd-be8e-de9534bbb3a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3', 'volume_size': 1}
Nov 05 15:05:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=976371b1-2a8b-43fe-9691-c7daaf23e8de,created_at=2026-11-05T14:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2047872747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=976371b1-2a8b-43fe-9691-c7daaf23e8de,host='devstack@QuobyteHD#QuobyteHD',id=b14c7f17-5048-4cfd-be8e-de9534bbb3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f4ab8cf4a14c5ab7c199929069a2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:59Z,use_quota=True,user_id='99bdc2d732cb4c9f9c1fc3209edb1317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(321a6e62-23a5-4836-b0ff-a1666fa84c92),volume_type_id=321a6e62-23a5-4836-b0ff-a1666fa84c92)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Creating volume b14c7f17-5048-4cfd-be8e-de9534bbb3a3 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:05:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:05:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:05:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:05:59 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:05:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:05:59 devstack sudo[90567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3 1073741824
Nov 05 15:05:59 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:00 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3 1073741824" returned: 0 in 1.151s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:00 devstack sudo[90591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3
Nov 05 15:06:00 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:01 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3" returned: 0 in 0.873s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] <== create_volume: return (2227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:06:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.245s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:06:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76201e2-7c21-4ad6-babb-84ef95e6864c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1c81c8-b13c-4e1f-aa0d-1bbda33a7936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:01 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Volume volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3 (b14c7f17-5048-4cfd-be8e-de9534bbb3a3): created successfully
Nov 05 15:06:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1c81c8-b13c-4e1f-aa0d-1bbda33a7936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Flow 'volume_create_manager' (85f2fda9-558b-4dbf-bd51-133b95b7c7e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:06:02 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0686c233-c836-47d1-ad19-0cc5d1d190bb tempest-GroupSnapshotsTest-714654516 None] Created volume successfully.
Nov 05 15:06:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-6d07be18-7849-400a-9b75-7c1193b3195d req-3de020b9-dcee-4812-b658-0c0f017264a1 tempest-ServerActionsTestOtherA-844328353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:06:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-6d07be18-7849-400a-9b75-7c1193b3195d req-3de020b9-dcee-4812-b658-0c0f017264a1 tempest-ServerActionsTestOtherA-844328353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:06:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-6d07be18-7849-400a-9b75-7c1193b3195d req-3de020b9-dcee-4812-b658-0c0f017264a1 tempest-ServerActionsTestOtherA-844328353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.071s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:06:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2354d3a0-81f8-44db-aeea-89ae62915ade tempest-GroupSnapshotsTest-714654516 None] Update group completed successfully.
Nov 05 15:06:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-6d07be18-7849-400a-9b75-7c1193b3195d req-3de020b9-dcee-4812-b658-0c0f017264a1 tempest-ServerActionsTestOtherA-844328353 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628', 'name': 'volume-91989d49-c84f-4898-b4e6-706228ac19c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b4b64a5-bb05-4917-bbe2-9d042fe2c341', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 15:06:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-6d07be18-7849-400a-9b75-7c1193b3195d req-3de020b9-dcee-4812-b658-0c0f017264a1 tempest-ServerActionsTestOtherA-844328353 None] attachment_update completed successfully.
Nov 05 15:06:04 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a93e063c-fc6c-4698-885b-75f9eef023d9 tempest-GroupSnapshotsTest-714654516 None] Update group completed successfully.
Nov 05 15:06:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-fadff04d-5266-4441-b9d5-0376472dda3e tempest-GroupSnapshotsTest-714654516 None] Update group completed successfully.
Nov 05 15:06:07 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-63d79716-ddeb-4d1a-a99a-b2ef6e91cdd3 tempest-GroupSnapshotsTest-714654516 None] Update group completed successfully.
Nov 05 15:06:10 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] GroupSnapshot 1cd04e07-8445-4b3b-9e9c-9259f4ec3cb8: creating.
Nov 05 15:06:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] Group snapshot 1cd04e07-8445-4b3b-9e9c-9259f4ec3cb8: creating. {{(pid=87150) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 15:06:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:06:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:06:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] Creating offline snapshot 56a2da72-d49a-4ca5-991f-24a80686ba33 of volume b14c7f17-5048-4cfd-be8e-de9534bbb3a3 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:06:10 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37a4fb4-228e-4d26-a158-6584b1dc2306]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:06:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:10 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-842b3353-5843-482d-bece-e5804b105bba req-7b939c94-83c3-448b-aad2-4b7707c84b7d tempest-ServerActionsTestOtherA-844328353 None] Terminate volume connection completed successfully.
Nov 05 15:06:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-842b3353-5843-482d-bece-e5804b105bba req-7b939c94-83c3-448b-aad2-4b7707c84b7d tempest-ServerActionsTestOtherA-844328353 None] Deleting attachment 9b4b64a5-bb05-4917-bbe2-9d042fe2c341. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 15:06:10 devstack sudo[91187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3
Nov 05 15:06:10 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:11 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3" returned: 0 in 1.208s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.56a2da72-d49a-4ca5-991f-24a80686ba33 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:11 devstack sudo[91239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.56a2da72-d49a-4ca5-991f-24a80686ba33 1G
Nov 05 15:06:11 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:12 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.56a2da72-d49a-4ca5-991f-24a80686ba33 1G" returned: 0 in 1.241s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.56a2da72-d49a-4ca5-991f-24a80686ba33 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:12 devstack sudo[91261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.56a2da72-d49a-4ca5-991f-24a80686ba33
Nov 05 15:06:12 devstack sudo[91261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-842b3353-5843-482d-bece-e5804b105bba req-37245260-7537-475e-9a6b-c1f85a0b278c tempest-ServerActionsTestOtherA-844328353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:06:13 devstack sudo[91261]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.56a2da72-d49a-4ca5-991f-24a80686ba33" returned: 0 in 0.637s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:13 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.56a2da72-d49a-4ca5-991f-24a80686ba33 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 15:06:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.56a2da72-d49a-4ca5-991f-24a80686ba33 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:13 devstack sudo[91268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.56a2da72-d49a-4ca5-991f-24a80686ba33
Nov 05 15:06:13 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:13 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.56a2da72-d49a-4ca5-991f-24a80686ba33" returned: 0 in 0.367s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:13 devstack sudo[91271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.info
Nov 05 15:06:13 devstack sudo[91271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:14 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:06:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Flow 'volume_create_manager' (844b559d-e729-4669-aaf4-8b19cc6fae90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:06:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0015251e-3791-4f69-90f4-88f5ac406948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0015251e-3791-4f69-90f4-88f5ac406948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1722521052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=089e8937-00e0-4da9-b97f-e94dfc4c9e25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82238d09c62747059d33805ba92a56bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:06:14Z,use_quota=True,user_id='87c8d8befd304034b0d8ece3720c45eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e67cb74-b0ae-4d92-8e95-ebf9efc2e994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e67cb74-b0ae-4d92-8e95-ebf9efc2e994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db65ad80-33d3-4aec-996e-07c24f6fa776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db65ad80-33d3-4aec-996e-07c24f6fa776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '089e8937-00e0-4da9-b97f-e94dfc4c9e25', 'volume_name': 'volume-089e8937-00e0-4da9-b97f-e94dfc4c9e25', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c64ec9-0164-4a72-9049-94b75db1f2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c64ec9-0164-4a72-9049-94b75db1f2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ff930e-aa49-4ab9-baab-1b17ed9ea02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:14 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Volume 089e8937-00e0-4da9-b97f-e94dfc4c9e25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-089e8937-00e0-4da9-b97f-e94dfc4c9e25', 'volume_size': 1}
Nov 05 15:06:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:06:14 devstack sudo[91271]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.info" returned: 0 in 0.559s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:14 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 15:06:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:14 devstack sudo[91274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.info
Nov 05 15:06:14 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:14 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.info" returned: 0 in 0.284s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.499s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:06:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:06:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:06:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] Creating offline snapshot 5c721c13-c323-4c17-8e0c-39d6d207293b of volume 6f95d4eb-5891-411d-80d2-ceedcae36bd1 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:06:14 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[620bb8fb-193a-4f93-a55e-9c019c4b3497]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:06:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:14 devstack sudo[91278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1
Nov 05 15:06:14 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:15 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1" returned: 0 in 0.470s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.5c721c13-c323-4c17-8e0c-39d6d207293b 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:15 devstack sudo[91284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.5c721c13-c323-4c17-8e0c-39d6d207293b 1G
Nov 05 15:06:15 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:15 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.5c721c13-c323-4c17-8e0c-39d6d207293b 1G" returned: 0 in 0.638s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.5c721c13-c323-4c17-8e0c-39d6d207293b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:15 devstack sudo[91290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.5c721c13-c323-4c17-8e0c-39d6d207293b
Nov 05 15:06:15 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:16 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.5c721c13-c323-4c17-8e0c-39d6d207293b" returned: 0 in 0.502s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:16 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.5c721c13-c323-4c17-8e0c-39d6d207293b is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 15:06:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.5c721c13-c323-4c17-8e0c-39d6d207293b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:16 devstack sudo[91295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.5c721c13-c323-4c17-8e0c-39d6d207293b
Nov 05 15:06:16 devstack sudo[91295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:16 devstack sudo[91295]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.5c721c13-c323-4c17-8e0c-39d6d207293b" returned: 0 in 0.296s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:16 devstack sudo[91298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.info
Nov 05 15:06:16 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:16 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.info" returned: 0 in 0.310s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:16 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 15:06:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:16 devstack sudo[91301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.info
Nov 05 15:06:16 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:17 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.info" returned: 0 in 0.306s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.631s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:06:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.994s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:06:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1722521052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=089e8937-00e0-4da9-b97f-e94dfc4c9e25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82238d09c62747059d33805ba92a56bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:06:14Z,use_quota=True,user_id='87c8d8befd304034b0d8ece3720c45eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:06:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Creating volume 089e8937-00e0-4da9-b97f-e94dfc4c9e25 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:06:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:06:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:06:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:06:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:06:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:06:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:06:17 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:06:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-089e8937-00e0-4da9-b97f-e94dfc4c9e25 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:17 devstack sudo[91304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-089e8937-00e0-4da9-b97f-e94dfc4c9e25 1073741824
Nov 05 15:06:17 devstack sudo[91304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:17 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-fa912463-2173-41d6-a761-8d21196656a8 tempest-GroupSnapshotsTest-714654516 None] group_snapshot 1cd04e07-8445-4b3b-9e9c-9259f4ec3cb8: created successfully
Nov 05 15:06:17 devstack sudo[91304]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-089e8937-00e0-4da9-b97f-e94dfc4c9e25 1073741824" returned: 0 in 0.529s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-089e8937-00e0-4da9-b97f-e94dfc4c9e25 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:17 devstack sudo[91311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-089e8937-00e0-4da9-b97f-e94dfc4c9e25
Nov 05 15:06:17 devstack sudo[91311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:18 devstack sudo[91311]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-089e8937-00e0-4da9-b97f-e94dfc4c9e25" returned: 0 in 0.269s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:06:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:06:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-842b3353-5843-482d-bece-e5804b105bba req-37245260-7537-475e-9a6b-c1f85a0b278c tempest-ServerActionsTestOtherA-844328353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.293s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:06:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ff930e-aa49-4ab9-baab-1b17ed9ea02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-089e8937-00e0-4da9-b97f-e94dfc4c9e25', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b0bd56-3e26-4a68-b1c7-56a04a2edadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-842b3353-5843-482d-bece-e5804b105bba req-37245260-7537-475e-9a6b-c1f85a0b278c tempest-ServerActionsTestOtherA-844328353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:06:18 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Volume volume-089e8937-00e0-4da9-b97f-e94dfc4c9e25 (089e8937-00e0-4da9-b97f-e94dfc4c9e25): created successfully
Nov 05 15:06:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b0bd56-3e26-4a68-b1c7-56a04a2edadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Flow 'volume_create_manager' (844b559d-e729-4669-aaf4-8b19cc6fae90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:06:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-92a2bb6c-03e4-4d4e-89ef-108b197f408e tempest-ServerRescueNegativeTestJSON-829870701 None] Created volume successfully.
Nov 05 15:06:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-842b3353-5843-482d-bece-e5804b105bba req-37245260-7537-475e-9a6b-c1f85a0b278c tempest-ServerActionsTestOtherA-844328353 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628', 'name': 'volume-91989d49-c84f-4898-b4e6-706228ac19c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3934c028-d68e-432e-a5a5-ad0390444db7', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 15:06:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-842b3353-5843-482d-bece-e5804b105bba req-37245260-7537-475e-9a6b-c1f85a0b278c tempest-ServerActionsTestOtherA-844328353 None] attachment_update completed successfully.
Nov 05 15:06:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] group_snapshot 1cd04e07-8445-4b3b-9e9c-9259f4ec3cb8: deleting
Nov 05 15:06:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] group_snapshot 1cd04e07-8445-4b3b-9e9c-9259f4ec3cb8: deleting {{(pid=87150) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 15:06:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "cinder-quobyte-b14c7f17-5048-4cfd-be8e-de9534bbb3a3" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:06:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-b14c7f17-5048-4cfd-be8e-de9534bbb3a3" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:06:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "cinder-quobyte-56a2da72-d49a-4ca5-991f-24a80686ba33" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:06:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-56a2da72-d49a-4ca5-991f-24a80686ba33" acquired by "_delete_snapshot" :: waited 0.061s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:06:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Deleting offline snapshot 56a2da72-d49a-4ca5-991f-24a80686ba33 of volume b14c7f17-5048-4cfd-be8e-de9534bbb3a3 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:06:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] snapshot_file for this snap is: volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.56a2da72-d49a-4ca5-991f-24a80686ba33 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:06:19 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5032e7ca-3dc1-47cd-8a5e-419db24dd2ff]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:06:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.56a2da72-d49a-4ca5-991f-24a80686ba33 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:19 devstack sudo[91317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.56a2da72-d49a-4ca5-991f-24a80686ba33
Nov 05 15:06:19 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:20 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.56a2da72-d49a-4ca5-991f-24a80686ba33" returned: 0 in 0.965s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:06:20 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92d6fc1-e236-4db5-be83-3686fc42ccc1]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:06:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:20 devstack sudo[91368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3
Nov 05 15:06:20 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:20 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3" returned: 0 in 0.672s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.56a2da72-d49a-4ca5-991f-24a80686ba33 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:20 devstack sudo[91392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.56a2da72-d49a-4ca5-991f-24a80686ba33
Nov 05 15:06:20 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:21 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.56a2da72-d49a-4ca5-991f-24a80686ba33" returned: 0 in 0.804s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.56a2da72-d49a-4ca5-991f-24a80686ba33 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:21 devstack sudo[91520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.56a2da72-d49a-4ca5-991f-24a80686ba33
Nov 05 15:06:21 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:22 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3.56a2da72-d49a-4ca5-991f-24a80686ba33" returned: 0 in 0.739s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-56a2da72-d49a-4ca5-991f-24a80686ba33" released by "_delete_snapshot" :: held 3.495s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:06:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-b14c7f17-5048-4cfd-be8e-de9534bbb3a3" released by "delete_snapshot" :: held 3.575s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:06:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "cinder-quobyte-6f95d4eb-5891-411d-80d2-ceedcae36bd1" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:06:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-6f95d4eb-5891-411d-80d2-ceedcae36bd1" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:06:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "cinder-quobyte-5c721c13-c323-4c17-8e0c-39d6d207293b" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:06:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-5c721c13-c323-4c17-8e0c-39d6d207293b" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:06:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Deleting offline snapshot 5c721c13-c323-4c17-8e0c-39d6d207293b of volume 6f95d4eb-5891-411d-80d2-ceedcae36bd1 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:06:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] snapshot_file for this snap is: volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.5c721c13-c323-4c17-8e0c-39d6d207293b {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:06:22 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbef930-5a3b-4587-8a65-2adc2f77824f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:06:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.5c721c13-c323-4c17-8e0c-39d6d207293b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:22 devstack sudo[91875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.5c721c13-c323-4c17-8e0c-39d6d207293b
Nov 05 15:06:22 devstack sudo[91875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:23 devstack sudo[91875]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.5c721c13-c323-4c17-8e0c-39d6d207293b" returned: 0 in 0.641s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:06:23 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fb6c3b-fd88-4228-bba2-a6c30eea4183]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:06:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:23 devstack sudo[91884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1
Nov 05 15:06:23 devstack sudo[91884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:24 devstack sudo[91884]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1" returned: 0 in 0.790s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.5c721c13-c323-4c17-8e0c-39d6d207293b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:24 devstack sudo[91892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.5c721c13-c323-4c17-8e0c-39d6d207293b
Nov 05 15:06:24 devstack sudo[91892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:25 devstack sudo[91892]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.5c721c13-c323-4c17-8e0c-39d6d207293b" returned: 0 in 1.006s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.5c721c13-c323-4c17-8e0c-39d6d207293b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:25 devstack sudo[91920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.5c721c13-c323-4c17-8e0c-39d6d207293b
Nov 05 15:06:25 devstack sudo[91920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:25 devstack sudo[91920]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1.5c721c13-c323-4c17-8e0c-39d6d207293b" returned: 0 in 0.654s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-5c721c13-c323-4c17-8e0c-39d6d207293b" released by "_delete_snapshot" :: held 3.337s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:06:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-6f95d4eb-5891-411d-80d2-ceedcae36bd1" released by "delete_snapshot" :: held 3.395s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:06:26 devstack cinder-volume[87150]: WARNING cinder.quota [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-845474151 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-845474151, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:06:26 devstack cinder-volume[87150]: WARNING cinder.quota [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-845474151 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-845474151, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:06:26 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Created reservations ['5eab2f62-5bbe-41b4-b750-5165ba9f5183', 'e7f48d54-a541-44fb-9944-5e3ca6885d71', '66f2c377-3e6b-4bd0-b5ae-cb85f9bc4de9', '8b151603-bf9f-4546-9caf-8c800d864c3b'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:06:26 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] Created reservations ['8694d5d2-8dff-475e-a169-1f0d4bfdf2fd', 'b4739980-5034-40f1-a5a5-654210c9a5a3', '2cd136bb-b440-47b7-bc8b-40859e7122a5', 'b300bf25-850c-4549-8d31-0105bb2be69b'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:06:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-afc882d4-56ab-4e00-8532-2c58bae320a9 tempest-GroupSnapshotsTest-714654516 None] group_snapshot 1cd04e07-8445-4b3b-9e9c-9259f4ec3cb8: deleted successfully
Nov 05 15:06:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "cinder-quobyte-6f95d4eb-5891-411d-80d2-ceedcae36bd1" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:06:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-6f95d4eb-5891-411d-80d2-ceedcae36bd1" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:06:28 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f41beb1-0ad6-4494-84e7-c1d7d4d40ac8]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:06:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:28 devstack sudo[91997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1
Nov 05 15:06:28 devstack sudo[91997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:28 devstack sudo[91997]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1" returned: 0 in 0.552s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:28 devstack sudo[92008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1
Nov 05 15:06:28 devstack sudo[92008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:29 devstack sudo[92008]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6f95d4eb-5891-411d-80d2-ceedcae36bd1" returned: 0 in 0.393s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-6f95d4eb-5891-411d-80d2-ceedcae36bd1" released by "delete_volume" :: held 1.048s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:06:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "cinder-quobyte-b14c7f17-5048-4cfd-be8e-de9534bbb3a3" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:06:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-b14c7f17-5048-4cfd-be8e-de9534bbb3a3" acquired by "delete_volume" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:06:29 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[031fb24f-8c96-492f-87c4-87b11091cb94]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:06:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:29 devstack sudo[92012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3
Nov 05 15:06:29 devstack sudo[92012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:29 devstack sudo[92012]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3" returned: 0 in 0.679s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:29 devstack sudo[92019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3
Nov 05 15:06:29 devstack sudo[92019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:30 devstack sudo[92019]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b14c7f17-5048-4cfd-be8e-de9534bbb3a3" returned: 0 in 0.397s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-17428682-da68-4b2a-8564-a5b20c4cb2dc tempest-ServerRescueNegativeTestJSON-829870701 None] Acquiring lock "cinder-089e8937-00e0-4da9-b97f-e94dfc4c9e25-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:06:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-b14c7f17-5048-4cfd-be8e-de9534bbb3a3" released by "delete_volume" :: held 1.241s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:06:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-17428682-da68-4b2a-8564-a5b20c4cb2dc tempest-ServerRescueNegativeTestJSON-829870701 None] Lock "cinder-089e8937-00e0-4da9-b97f-e94dfc4c9e25-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:06:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-17428682-da68-4b2a-8564-a5b20c4cb2dc tempest-ServerRescueNegativeTestJSON-829870701 None] Acquiring lock "cinder-quobyte-089e8937-00e0-4da9-b97f-e94dfc4c9e25" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:06:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-17428682-da68-4b2a-8564-a5b20c4cb2dc tempest-ServerRescueNegativeTestJSON-829870701 None] Lock "cinder-quobyte-089e8937-00e0-4da9-b97f-e94dfc4c9e25" acquired by "delete_volume" :: waited 0.043s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:06:30 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a0ff7c-9fa4-4982-bbe1-887b7fe5660a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:06:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-17428682-da68-4b2a-8564-a5b20c4cb2dc tempest-ServerRescueNegativeTestJSON-829870701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-089e8937-00e0-4da9-b97f-e94dfc4c9e25 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:30 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] Created reservations ['e3a140b4-00fe-4dbf-bf51-7a8478a0e74c'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:06:30 devstack cinder-volume[87150]: WARNING cinder.quota [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-845474151 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-845474151, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:06:30 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] Created reservations ['4bb984e7-a029-4c91-8cff-71906b1cd152', '7f173473-8db9-4bfb-acca-279af737b921', '610b45fc-2650-431a-ab9f-e3c06996d70b', '1160381b-8268-4f1e-abe4-869a755f779f'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:06:30 devstack sudo[92022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-089e8937-00e0-4da9-b97f-e94dfc4c9e25
Nov 05 15:06:30 devstack sudo[92022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:30 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] Created reservations ['d26fbbcd-be37-4a97-a39d-a722bb93a2e8', '17412a51-45ad-4105-8937-1789825d5090', 'c71ef656-17db-4b7b-9e69-1ceac4e24771', '5d7d6814-03ff-4506-869a-3bffb45b661d'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:31 devstack sudo[92026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:06:31 devstack sudo[92026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:06:31 devstack sudo[92022]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Flow 'volume_create_manager' (44f32970-7049-46c4-9de2-898fe753bd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e98b2b6-cea9-463e-9141-42d2c3ced8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-17428682-da68-4b2a-8564-a5b20c4cb2dc tempest-ServerRescueNegativeTestJSON-829870701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-089e8937-00e0-4da9-b97f-e94dfc4c9e25" returned: 0 in 0.770s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-17428682-da68-4b2a-8564-a5b20c4cb2dc tempest-ServerRescueNegativeTestJSON-829870701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-089e8937-00e0-4da9-b97f-e94dfc4c9e25 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e98b2b6-cea9-463e-9141-42d2c3ced8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1899353479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba98973d-c84d-435d-a931-98465d145ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbac5bd198a542d7b67c1150f89a8674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:06:31Z,use_quota=True,user_id='a9a20ed2c3494d3e8d67ce6462d5d90c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4d7543-ee64-420c-9b47-e47bc9a153e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4d7543-ee64-420c-9b47-e47bc9a153e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b053f59-8e14-418b-afef-e9d596412589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b053f59-8e14-418b-afef-e9d596412589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba98973d-c84d-435d-a931-98465d145ede', 'volume_name': 'volume-ba98973d-c84d-435d-a931-98465d145ede', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a998d4-3707-4572-b0ad-68b283b8ebfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a998d4-3707-4572-b0ad-68b283b8ebfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:31 devstack sudo[92029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-089e8937-00e0-4da9-b97f-e94dfc4c9e25
Nov 05 15:06:31 devstack sudo[92029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96566d25-790b-465b-b60d-000cfcb70640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:31 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Volume ba98973d-c84d-435d-a931-98465d145ede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba98973d-c84d-435d-a931-98465d145ede', 'volume_size': 1}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1899353479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba98973d-c84d-435d-a931-98465d145ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbac5bd198a542d7b67c1150f89a8674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:06:31Z,use_quota=True,user_id='a9a20ed2c3494d3e8d67ce6462d5d90c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Creating volume ba98973d-c84d-435d-a931-98465d145ede {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:06:31 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ba98973d-c84d-435d-a931-98465d145ede 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:31 devstack sudo[92031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ba98973d-c84d-435d-a931-98465d145ede 1073741824
Nov 05 15:06:31 devstack sudo[92031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:31 devstack sudo[92026]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.505s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:06:31 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-489d0971-af33-485e-bc97-4a71f22f6159 tempest-GroupSnapshotsTest-714654516 None] Delete group completed successfully.
Nov 05 15:06:31 devstack sudo[92029]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-17428682-da68-4b2a-8564-a5b20c4cb2dc tempest-ServerRescueNegativeTestJSON-829870701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-089e8937-00e0-4da9-b97f-e94dfc4c9e25" returned: 0 in 0.421s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-17428682-da68-4b2a-8564-a5b20c4cb2dc tempest-ServerRescueNegativeTestJSON-829870701 None] Lock "cinder-quobyte-089e8937-00e0-4da9-b97f-e94dfc4c9e25" released by "delete_volume" :: held 1.252s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-17428682-da68-4b2a-8564-a5b20c4cb2dc tempest-ServerRescueNegativeTestJSON-829870701 None] Created reservations ['82aae904-f92b-4a2c-b929-48b5bb6cb804', 'f33e1f19-1181-4b9f-b92a-685b9c662b45', '58bc7895-034c-4ad4-af47-3390e8ad1297', '92109ca1-e7b8-4c1a-bff7-51dfc81e6353'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-17428682-da68-4b2a-8564-a5b20c4cb2dc tempest-ServerRescueNegativeTestJSON-829870701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-17428682-da68-4b2a-8564-a5b20c4cb2dc tempest-ServerRescueNegativeTestJSON-829870701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-17428682-da68-4b2a-8564-a5b20c4cb2dc tempest-ServerRescueNegativeTestJSON-829870701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-17428682-da68-4b2a-8564-a5b20c4cb2dc tempest-ServerRescueNegativeTestJSON-829870701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-17428682-da68-4b2a-8564-a5b20c4cb2dc tempest-ServerRescueNegativeTestJSON-829870701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:06:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-17428682-da68-4b2a-8564-a5b20c4cb2dc tempest-ServerRescueNegativeTestJSON-829870701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:31 devstack sudo[92040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:06:31 devstack sudo[92040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:32 devstack sudo[92031]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ba98973d-c84d-435d-a931-98465d145ede 1073741824" returned: 0 in 0.802s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ba98973d-c84d-435d-a931-98465d145ede {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:32 devstack sudo[92042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ba98973d-c84d-435d-a931-98465d145ede
Nov 05 15:06:32 devstack sudo[92042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:32 devstack sudo[92040]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-17428682-da68-4b2a-8564-a5b20c4cb2dc tempest-ServerRescueNegativeTestJSON-829870701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.674s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:32 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-17428682-da68-4b2a-8564-a5b20c4cb2dc tempest-ServerRescueNegativeTestJSON-829870701 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:06:32 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-17428682-da68-4b2a-8564-a5b20c4cb2dc tempest-ServerRescueNegativeTestJSON-829870701 None] Deleted volume successfully.
Nov 05 15:06:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-17428682-da68-4b2a-8564-a5b20c4cb2dc tempest-ServerRescueNegativeTestJSON-829870701 None] Lock "cinder-089e8937-00e0-4da9-b97f-e94dfc4c9e25-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:06:32 devstack sudo[92042]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ba98973d-c84d-435d-a931-98465d145ede" returned: 0 in 0.646s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:06:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:06:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96566d25-790b-465b-b60d-000cfcb70640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba98973d-c84d-435d-a931-98465d145ede', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c581f826-8c5c-4524-9785-e49581610a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:33 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Volume volume-ba98973d-c84d-435d-a931-98465d145ede (ba98973d-c84d-435d-a931-98465d145ede): created successfully
Nov 05 15:06:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c581f826-8c5c-4524-9785-e49581610a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Flow 'volume_create_manager' (44f32970-7049-46c4-9de2-898fe753bd3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:06:33 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-33702d54-d70e-481a-9d88-c5a099bf27dc tempest-AttachVolumeNegativeTest-1140258724 None] Created volume successfully.
Nov 05 15:06:33 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-500e6e1b-a90f-4804-b9d8-f182a73c6b0e tempest-GroupSnapshotsTest-714654516 None] Group tempest-GroupSnapshotsTest-Group-1092890751: creating
Nov 05 15:06:33 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-500e6e1b-a90f-4804-b9d8-f182a73c6b0e tempest-GroupSnapshotsTest-714654516 None] Group tempest-GroupSnapshotsTest-Group-1092890751: created successfully
Nov 05 15:06:33 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-500e6e1b-a90f-4804-b9d8-f182a73c6b0e tempest-GroupSnapshotsTest-714654516 None] Create group completed successfully.
Nov 05 15:06:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-014ceb54-007c-4c63-bc59-399f5dda2de2 req-34a4d49d-dfd2-4fdd-91f8-6ee2700dc8dc tempest-AttachVolumeNegativeTest-1140258724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:06:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-014ceb54-007c-4c63-bc59-399f5dda2de2 req-34a4d49d-dfd2-4fdd-91f8-6ee2700dc8dc tempest-AttachVolumeNegativeTest-1140258724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:06:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-014ceb54-007c-4c63-bc59-399f5dda2de2 req-34a4d49d-dfd2-4fdd-91f8-6ee2700dc8dc tempest-AttachVolumeNegativeTest-1140258724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:06:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-014ceb54-007c-4c63-bc59-399f5dda2de2 req-34a4d49d-dfd2-4fdd-91f8-6ee2700dc8dc tempest-AttachVolumeNegativeTest-1140258724 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628', 'name': 'volume-ba98973d-c84d-435d-a931-98465d145ede', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ee59a63-3c4a-48c7-bbe3-28528f6becd1', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 15:06:36 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-014ceb54-007c-4c63-bc59-399f5dda2de2 req-34a4d49d-dfd2-4fdd-91f8-6ee2700dc8dc tempest-AttachVolumeNegativeTest-1140258724 None] attachment_update completed successfully.
Nov 05 15:06:36 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:06:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Flow 'volume_create_manager' (14f76745-9df7-413d-b05a-6f1297e54722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:06:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c317af50-07ed-4361-ab92-f7b604ad24c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c317af50-07ed-4361-ab92-f7b604ad24c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1292243687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7992ede5-c2bc-4f84-931c-51c95d8ab9f7,host='devstack@QuobyteHD#QuobyteHD',id=1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f4ab8cf4a14c5ab7c199929069a2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:06:36Z,use_quota=True,user_id='99bdc2d732cb4c9f9c1fc3209edb1317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3bb2b64-1ddb-4159-80c5-b62138cd3a69),volume_type_id=b3bb2b64-1ddb-4159-80c5-b62138cd3a69)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96806fb7-d2eb-4537-a8fb-5ae5140c5095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96806fb7-d2eb-4537-a8fb-5ae5140c5095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3d9ef9-a095-4a6e-a99e-d3b637d2db26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3d9ef9-a095-4a6e-a99e-d3b637d2db26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d', 'volume_name': 'volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b4ca2a-819a-46b8-bb8c-a18215464d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b4ca2a-819a-46b8-bb8c-a18215464d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51308375-08a8-40c0-8533-fc701632b424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:36 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Volume 1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d', 'volume_size': 1}
Nov 05 15:06:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:06:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:06:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7992ede5-c2bc-4f84-931c-51c95d8ab9f7,created_at=2026-11-05T14:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1292243687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7992ede5-c2bc-4f84-931c-51c95d8ab9f7,host='devstack@QuobyteHD#QuobyteHD',id=1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f4ab8cf4a14c5ab7c199929069a2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:06:36Z,use_quota=True,user_id='99bdc2d732cb4c9f9c1fc3209edb1317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3bb2b64-1ddb-4159-80c5-b62138cd3a69),volume_type_id=b3bb2b64-1ddb-4159-80c5-b62138cd3a69)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:06:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Creating volume 1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:06:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:06:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:06:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:06:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:06:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:06:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:06:36 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:06:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:36 devstack sudo[92090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d 1073741824
Nov 05 15:06:36 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:36 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d 1073741824" returned: 0 in 0.788s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:37 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=103,cinder:UPDATE=95,cinder:INSERT=24 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:06:37 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=97,cinder:SELECT=109,cinder:INSERT=18,cinder:DELETE=5 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:06:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:37 devstack sudo[92098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d
Nov 05 15:06:37 devstack sudo[92098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:06:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:06:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:06:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:06:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:06:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:06:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:37 devstack sudo[92100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:06:37 devstack sudo[92100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:37 devstack sudo[92098]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d" returned: 0 in 0.428s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:06:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:06:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51308375-08a8-40c0-8533-fc701632b424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3292dd75-c698-4660-8b5c-6f256f6ce8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:37 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Volume volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d (1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d): created successfully
Nov 05 15:06:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3292dd75-c698-4660-8b5c-6f256f6ce8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Flow 'volume_create_manager' (14f76745-9df7-413d-b05a-6f1297e54722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:06:37 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6db2aa5f-acbf-4d21-94d5-00fb2095852b tempest-GroupSnapshotsTest-714654516 None] Created volume successfully.
Nov 05 15:06:37 devstack sudo[92100]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.349s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:06:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:06:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread count: 8 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 15:06:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread info: [<_MainThread(MainThread, started 136317437956224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136317326340928)>, <Thread(Thread-3 (stat_writer), started daemon 136317326487936)>, <Thread(Rabbit-heartbeat, started daemon 136317321464000)>, <Thread(Thread-5 (_runner), started daemon 136317321550592)>, <Thread(Thread-7 (_runner), started daemon 136317321658496)>, <Thread(fd_logger, started daemon 136317319612992)>, <Thread(privsep_reader, started daemon 136317319622400)>] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 15:06:39 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5855129e-f5cd-43e0-884b-0eb07b585a7f tempest-GroupSnapshotsTest-714654516 None] GroupSnapshot 7c78a00b-6e72-474c-a307-58e9385264f6: creating.
Nov 05 15:06:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5855129e-f5cd-43e0-884b-0eb07b585a7f tempest-GroupSnapshotsTest-714654516 None] Group snapshot 7c78a00b-6e72-474c-a307-58e9385264f6: creating. {{(pid=87150) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 15:06:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5855129e-f5cd-43e0-884b-0eb07b585a7f tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:06:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5855129e-f5cd-43e0-884b-0eb07b585a7f tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:06:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-5855129e-f5cd-43e0-884b-0eb07b585a7f tempest-GroupSnapshotsTest-714654516 None] Creating offline snapshot 7bc8da41-93b2-463e-8c6b-4a0e82b5c8db of volume 1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:06:39 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c899d7f-8e51-44ba-8a18-ee7db3293674]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:06:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5855129e-f5cd-43e0-884b-0eb07b585a7f tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:39 devstack sudo[92126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d
Nov 05 15:06:39 devstack sudo[92126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:39 devstack sudo[92126]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5855129e-f5cd-43e0-884b-0eb07b585a7f tempest-GroupSnapshotsTest-714654516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d" returned: 0 in 0.775s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5855129e-f5cd-43e0-884b-0eb07b585a7f tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.7bc8da41-93b2-463e-8c6b-4a0e82b5c8db 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:40 devstack sudo[92135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.7bc8da41-93b2-463e-8c6b-4a0e82b5c8db 1G
Nov 05 15:06:40 devstack sudo[92135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:40 devstack sudo[92135]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5855129e-f5cd-43e0-884b-0eb07b585a7f tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.7bc8da41-93b2-463e-8c6b-4a0e82b5c8db 1G" returned: 0 in 0.743s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5855129e-f5cd-43e0-884b-0eb07b585a7f tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.7bc8da41-93b2-463e-8c6b-4a0e82b5c8db {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:40 devstack sudo[92173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.7bc8da41-93b2-463e-8c6b-4a0e82b5c8db
Nov 05 15:06:40 devstack sudo[92173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:41 devstack sudo[92173]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5855129e-f5cd-43e0-884b-0eb07b585a7f tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.7bc8da41-93b2-463e-8c6b-4a0e82b5c8db" returned: 0 in 0.412s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:41 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-5855129e-f5cd-43e0-884b-0eb07b585a7f tempest-GroupSnapshotsTest-714654516 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.7bc8da41-93b2-463e-8c6b-4a0e82b5c8db is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 15:06:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5855129e-f5cd-43e0-884b-0eb07b585a7f tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.7bc8da41-93b2-463e-8c6b-4a0e82b5c8db {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:41 devstack sudo[92202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.7bc8da41-93b2-463e-8c6b-4a0e82b5c8db
Nov 05 15:06:41 devstack sudo[92202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:41 devstack sudo[92202]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5855129e-f5cd-43e0-884b-0eb07b585a7f tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.7bc8da41-93b2-463e-8c6b-4a0e82b5c8db" returned: 0 in 0.363s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5855129e-f5cd-43e0-884b-0eb07b585a7f tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:41 devstack sudo[92206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.info
Nov 05 15:06:41 devstack sudo[92206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:41 devstack sudo[92206]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5855129e-f5cd-43e0-884b-0eb07b585a7f tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.info" returned: 0 in 0.297s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:41 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-5855129e-f5cd-43e0-884b-0eb07b585a7f tempest-GroupSnapshotsTest-714654516 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 15:06:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5855129e-f5cd-43e0-884b-0eb07b585a7f tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:41 devstack sudo[92212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.info
Nov 05 15:06:41 devstack sudo[92212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:42 devstack sudo[92212]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5855129e-f5cd-43e0-884b-0eb07b585a7f tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.info" returned: 0 in 0.282s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5855129e-f5cd-43e0-884b-0eb07b585a7f tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.037s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:06:42 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5855129e-f5cd-43e0-884b-0eb07b585a7f tempest-GroupSnapshotsTest-714654516 None] group_snapshot 7c78a00b-6e72-474c-a307-58e9385264f6: created successfully
Nov 05 15:06:42 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-bad73f0b-3d2c-4fc6-a7db-a2da83b76c14 tempest-GroupSnapshotsTest-714654516 None] group_snapshot 7c78a00b-6e72-474c-a307-58e9385264f6: deleting
Nov 05 15:06:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bad73f0b-3d2c-4fc6-a7db-a2da83b76c14 tempest-GroupSnapshotsTest-714654516 None] group_snapshot 7c78a00b-6e72-474c-a307-58e9385264f6: deleting {{(pid=87150) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 15:06:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bad73f0b-3d2c-4fc6-a7db-a2da83b76c14 tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "cinder-quobyte-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:06:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bad73f0b-3d2c-4fc6-a7db-a2da83b76c14 tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:06:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bad73f0b-3d2c-4fc6-a7db-a2da83b76c14 tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "cinder-quobyte-7bc8da41-93b2-463e-8c6b-4a0e82b5c8db" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:06:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bad73f0b-3d2c-4fc6-a7db-a2da83b76c14 tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-7bc8da41-93b2-463e-8c6b-4a0e82b5c8db" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:06:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-bad73f0b-3d2c-4fc6-a7db-a2da83b76c14 tempest-GroupSnapshotsTest-714654516 None] Deleting offline snapshot 7bc8da41-93b2-463e-8c6b-4a0e82b5c8db of volume 1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:06:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-bad73f0b-3d2c-4fc6-a7db-a2da83b76c14 tempest-GroupSnapshotsTest-714654516 None] snapshot_file for this snap is: volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.7bc8da41-93b2-463e-8c6b-4a0e82b5c8db {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:06:42 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb73d242-6fc4-4b00-8d9f-06b0aaab444b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:06:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bad73f0b-3d2c-4fc6-a7db-a2da83b76c14 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.7bc8da41-93b2-463e-8c6b-4a0e82b5c8db {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:42 devstack sudo[92216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.7bc8da41-93b2-463e-8c6b-4a0e82b5c8db
Nov 05 15:06:42 devstack sudo[92216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:43 devstack sudo[92216]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bad73f0b-3d2c-4fc6-a7db-a2da83b76c14 tempest-GroupSnapshotsTest-714654516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.7bc8da41-93b2-463e-8c6b-4a0e82b5c8db" returned: 0 in 0.435s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-bad73f0b-3d2c-4fc6-a7db-a2da83b76c14 tempest-GroupSnapshotsTest-714654516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:06:43 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adda974-3725-4fd7-a889-e4a841b072e1]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:06:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bad73f0b-3d2c-4fc6-a7db-a2da83b76c14 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:43 devstack sudo[92221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d
Nov 05 15:06:43 devstack sudo[92221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:43 devstack sudo[92221]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bad73f0b-3d2c-4fc6-a7db-a2da83b76c14 tempest-GroupSnapshotsTest-714654516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d" returned: 0 in 0.500s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bad73f0b-3d2c-4fc6-a7db-a2da83b76c14 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.7bc8da41-93b2-463e-8c6b-4a0e82b5c8db {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:43 devstack sudo[92233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.7bc8da41-93b2-463e-8c6b-4a0e82b5c8db
Nov 05 15:06:43 devstack sudo[92233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:44 devstack sudo[92233]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bad73f0b-3d2c-4fc6-a7db-a2da83b76c14 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.7bc8da41-93b2-463e-8c6b-4a0e82b5c8db" returned: 0 in 0.460s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bad73f0b-3d2c-4fc6-a7db-a2da83b76c14 tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.7bc8da41-93b2-463e-8c6b-4a0e82b5c8db {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:44 devstack sudo[92249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.7bc8da41-93b2-463e-8c6b-4a0e82b5c8db
Nov 05 15:06:44 devstack sudo[92249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:44 devstack sudo[92249]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bad73f0b-3d2c-4fc6-a7db-a2da83b76c14 tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d.7bc8da41-93b2-463e-8c6b-4a0e82b5c8db" returned: 0 in 0.311s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bad73f0b-3d2c-4fc6-a7db-a2da83b76c14 tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-7bc8da41-93b2-463e-8c6b-4a0e82b5c8db" released by "_delete_snapshot" :: held 1.863s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:06:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bad73f0b-3d2c-4fc6-a7db-a2da83b76c14 tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d" released by "delete_snapshot" :: held 1.894s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:06:44 devstack cinder-volume[87150]: WARNING cinder.quota [None req-bad73f0b-3d2c-4fc6-a7db-a2da83b76c14 tempest-GroupSnapshotsTest-714654516 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1204920657 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1204920657, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:06:44 devstack cinder-volume[87150]: WARNING cinder.quota [None req-bad73f0b-3d2c-4fc6-a7db-a2da83b76c14 tempest-GroupSnapshotsTest-714654516 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1204920657 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1204920657, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:06:44 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-bad73f0b-3d2c-4fc6-a7db-a2da83b76c14 tempest-GroupSnapshotsTest-714654516 None] Created reservations ['d2f51a1a-d521-4ebf-93e2-79ceec57decf', 'ef67b123-d1e2-4e76-a7de-687799baba79', '39df1039-a543-407d-b0b5-6e1a1eabbca9', 'd411847d-f8d4-4135-9546-9360babaa15a'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:06:44 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-bad73f0b-3d2c-4fc6-a7db-a2da83b76c14 tempest-GroupSnapshotsTest-714654516 None] group_snapshot 7c78a00b-6e72-474c-a307-58e9385264f6: deleted successfully
Nov 05 15:06:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-def5c5fc-c4b4-4544-856e-48fa2b6a8fcd tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "cinder-quobyte-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:06:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-def5c5fc-c4b4-4544-856e-48fa2b6a8fcd tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:06:45 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[edce13df-3539-4753-a292-9e3cc3833f0a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:06:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-def5c5fc-c4b4-4544-856e-48fa2b6a8fcd tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:45 devstack sudo[92256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d
Nov 05 15:06:45 devstack sudo[92256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:45 devstack sudo[92256]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-def5c5fc-c4b4-4544-856e-48fa2b6a8fcd tempest-GroupSnapshotsTest-714654516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d" returned: 0 in 0.436s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-def5c5fc-c4b4-4544-856e-48fa2b6a8fcd tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:45 devstack sudo[92262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d
Nov 05 15:06:45 devstack sudo[92262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:46 devstack sudo[92262]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-def5c5fc-c4b4-4544-856e-48fa2b6a8fcd tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d" returned: 0 in 0.367s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-def5c5fc-c4b4-4544-856e-48fa2b6a8fcd tempest-GroupSnapshotsTest-714654516 None] Lock "cinder-quobyte-1c2065fb-3d0c-4c3f-b0d6-3c1627a8fa9d" released by "delete_volume" :: held 0.932s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:06:46 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-def5c5fc-c4b4-4544-856e-48fa2b6a8fcd tempest-GroupSnapshotsTest-714654516 None] Created reservations ['43e1c920-1eaa-4b12-9008-6bf80dd65a00'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:06:46 devstack cinder-volume[87150]: WARNING cinder.quota [None req-def5c5fc-c4b4-4544-856e-48fa2b6a8fcd tempest-GroupSnapshotsTest-714654516 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1204920657 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1204920657, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:06:46 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-def5c5fc-c4b4-4544-856e-48fa2b6a8fcd tempest-GroupSnapshotsTest-714654516 None] Created reservations ['4075293e-a695-4986-859a-c4da2a5c3ed2', '1f6b94b1-74c2-4fc3-8721-bcd2fb2fdc41', 'b2ab9ec7-415f-42fa-bcd1-571668b87038', 'db116045-a4d9-447a-814e-90dd6359967f'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:06:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-def5c5fc-c4b4-4544-856e-48fa2b6a8fcd tempest-GroupSnapshotsTest-714654516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:06:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-def5c5fc-c4b4-4544-856e-48fa2b6a8fcd tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:06:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-def5c5fc-c4b4-4544-856e-48fa2b6a8fcd tempest-GroupSnapshotsTest-714654516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:06:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-def5c5fc-c4b4-4544-856e-48fa2b6a8fcd tempest-GroupSnapshotsTest-714654516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:06:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-def5c5fc-c4b4-4544-856e-48fa2b6a8fcd tempest-GroupSnapshotsTest-714654516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:06:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-def5c5fc-c4b4-4544-856e-48fa2b6a8fcd tempest-GroupSnapshotsTest-714654516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:47 devstack sudo[92307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:06:47 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:47 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-def5c5fc-c4b4-4544-856e-48fa2b6a8fcd tempest-GroupSnapshotsTest-714654516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.460s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:47 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-def5c5fc-c4b4-4544-856e-48fa2b6a8fcd tempest-GroupSnapshotsTest-714654516 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:06:47 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-def5c5fc-c4b4-4544-856e-48fa2b6a8fcd tempest-GroupSnapshotsTest-714654516 None] Delete group completed successfully.
Nov 05 15:06:54 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ddebf919-25e3-4611-9090-da84016ee334 tempest-GroupsV320Test-1676550566 None] Group tempest-GroupsV320Test-Group-544341113: creating
Nov 05 15:06:54 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ddebf919-25e3-4611-9090-da84016ee334 tempest-GroupsV320Test-1676550566 None] Group tempest-GroupsV320Test-Group-544341113: created successfully
Nov 05 15:06:54 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ddebf919-25e3-4611-9090-da84016ee334 tempest-GroupsV320Test-1676550566 None] Create group completed successfully.
Nov 05 15:06:56 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-ccd580ab-3294-4131-a009-2c4eaa9a33d1 tempest-GroupsV320Test-1676550566 None] Created reservations ['9d4f5170-71da-42b0-ba76-e1dfb476ac50'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:06:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ccd580ab-3294-4131-a009-2c4eaa9a33d1 tempest-GroupsV320Test-1676550566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:06:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ccd580ab-3294-4131-a009-2c4eaa9a33d1 tempest-GroupsV320Test-1676550566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:06:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ccd580ab-3294-4131-a009-2c4eaa9a33d1 tempest-GroupsV320Test-1676550566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:06:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ccd580ab-3294-4131-a009-2c4eaa9a33d1 tempest-GroupsV320Test-1676550566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:06:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ccd580ab-3294-4131-a009-2c4eaa9a33d1 tempest-GroupsV320Test-1676550566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:06:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ccd580ab-3294-4131-a009-2c4eaa9a33d1 tempest-GroupsV320Test-1676550566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:56 devstack sudo[92320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:06:56 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:56 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4b40c70e-12a5-4f3f-9ee4-24dd8026857b tempest-GroupSnapshotsV319Test-1660474245 None] Group tempest-GroupSnapshotsV319Test-Group-790358672: creating
Nov 05 15:06:56 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ccd580ab-3294-4131-a009-2c4eaa9a33d1 tempest-GroupsV320Test-1676550566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.316s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:56 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-ccd580ab-3294-4131-a009-2c4eaa9a33d1 tempest-GroupsV320Test-1676550566 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:06:56 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4b40c70e-12a5-4f3f-9ee4-24dd8026857b tempest-GroupSnapshotsV319Test-1660474245 None] Group tempest-GroupSnapshotsV319Test-Group-790358672: created successfully
Nov 05 15:06:56 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ccd580ab-3294-4131-a009-2c4eaa9a33d1 tempest-GroupsV320Test-1676550566 None] Delete group completed successfully.
Nov 05 15:06:56 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4b40c70e-12a5-4f3f-9ee4-24dd8026857b tempest-GroupSnapshotsV319Test-1660474245 None] Create group completed successfully.
Nov 05 15:06:58 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:06:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Flow 'volume_create_manager' (32fc34e9-d448-4002-a309-c75aae4f910b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:06:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef19fb34-4d72-4ef0-a815-2a1ce8399207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef19fb34-4d72-4ef0-a815-2a1ce8399207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1939902497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d5a0e19c-3a9e-42f2-9bf5-23422c30bf14,host='devstack@QuobyteHD#QuobyteHD',id=f3f6b7de-cc5d-46e8-b1e3-3987d12631a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cb6278758164d358aa0baba509f9e69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:06:59Z,use_quota=True,user_id='9a08956e5aad44709118887af3357466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce96a452-f300-43ed-a8e4-eeb18f5c9c89),volume_type_id=ce96a452-f300-43ed-a8e4-eeb18f5c9c89)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a16252d-03f6-4354-85b9-91980c027397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a16252d-03f6-4354-85b9-91980c027397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40fad504-1fd5-43e9-a61c-ab1b81d26d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40fad504-1fd5-43e9-a61c-ab1b81d26d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3f6b7de-cc5d-46e8-b1e3-3987d12631a4', 'volume_name': 'volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (314450fb-b5f8-4c8d-b270-c82b1f2c95ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (314450fb-b5f8-4c8d-b270-c82b1f2c95ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb42080-a012-4897-b748-8dc86d5aec65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:58 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Volume f3f6b7de-cc5d-46e8-b1e3-3987d12631a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4', 'volume_size': 1}
Nov 05 15:06:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:06:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:06:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d5a0e19c-3a9e-42f2-9bf5-23422c30bf14,created_at=2026-11-05T14:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1939902497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d5a0e19c-3a9e-42f2-9bf5-23422c30bf14,host='devstack@QuobyteHD#QuobyteHD',id=f3f6b7de-cc5d-46e8-b1e3-3987d12631a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cb6278758164d358aa0baba509f9e69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:06:59Z,use_quota=True,user_id='9a08956e5aad44709118887af3357466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce96a452-f300-43ed-a8e4-eeb18f5c9c89),volume_type_id=ce96a452-f300-43ed-a8e4-eeb18f5c9c89)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:06:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Creating volume f3f6b7de-cc5d-46e8-b1e3-3987d12631a4 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:06:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:06:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:06:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:06:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:06:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:06:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:06:58 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:06:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:58 devstack sudo[92324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4 1073741824
Nov 05 15:06:58 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:59 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4 1073741824" returned: 0 in 0.556s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:06:59 devstack sudo[92330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4
Nov 05 15:06:59 devstack sudo[92330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:06:59 devstack sudo[92330]: pam_unix(sudo:session): session closed for user root
Nov 05 15:06:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4" returned: 0 in 0.293s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:06:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:06:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:06:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb42080-a012-4897-b748-8dc86d5aec65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a479aa-7629-4a11-a82c-9f2836e5948f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:06:59 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Volume volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4 (f3f6b7de-cc5d-46e8-b1e3-3987d12631a4): created successfully
Nov 05 15:06:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a479aa-7629-4a11-a82c-9f2836e5948f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:06:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Flow 'volume_create_manager' (32fc34e9-d448-4002-a309-c75aae4f910b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:06:59 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6d9b6263-8a4b-47c4-96f9-46447d754ca7 tempest-GroupSnapshotsV319Test-1660474245 None] Created volume successfully.
Nov 05 15:07:00 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1432de73-f371-47fd-a2d7-1b082e93f08c tempest-GroupSnapshotsV319Test-1660474245 None] GroupSnapshot bbe1c74c-cc81-40ec-a2db-bdfd48a45640: creating.
Nov 05 15:07:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1432de73-f371-47fd-a2d7-1b082e93f08c tempest-GroupSnapshotsV319Test-1660474245 None] Group snapshot bbe1c74c-cc81-40ec-a2db-bdfd48a45640: creating. {{(pid=87150) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 15:07:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1432de73-f371-47fd-a2d7-1b082e93f08c tempest-GroupSnapshotsV319Test-1660474245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:07:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1432de73-f371-47fd-a2d7-1b082e93f08c tempest-GroupSnapshotsV319Test-1660474245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:07:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1432de73-f371-47fd-a2d7-1b082e93f08c tempest-GroupSnapshotsV319Test-1660474245 None] Creating offline snapshot 2b148bc6-e6df-4113-add4-c7eeb94729eb of volume f3f6b7de-cc5d-46e8-b1e3-3987d12631a4 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:07:00 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[931c7582-0472-4d66-b4d4-ebe09e503e15]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:07:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1432de73-f371-47fd-a2d7-1b082e93f08c tempest-GroupSnapshotsV319Test-1660474245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:00 devstack sudo[92333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4
Nov 05 15:07:00 devstack sudo[92333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:00 devstack sudo[92333]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1432de73-f371-47fd-a2d7-1b082e93f08c tempest-GroupSnapshotsV319Test-1660474245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4" returned: 0 in 0.449s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1432de73-f371-47fd-a2d7-1b082e93f08c tempest-GroupSnapshotsV319Test-1660474245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.2b148bc6-e6df-4113-add4-c7eeb94729eb 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:00 devstack sudo[92338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.2b148bc6-e6df-4113-add4-c7eeb94729eb 1G
Nov 05 15:07:00 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:01 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1432de73-f371-47fd-a2d7-1b082e93f08c tempest-GroupSnapshotsV319Test-1660474245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.2b148bc6-e6df-4113-add4-c7eeb94729eb 1G" returned: 0 in 0.492s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1432de73-f371-47fd-a2d7-1b082e93f08c tempest-GroupSnapshotsV319Test-1660474245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.2b148bc6-e6df-4113-add4-c7eeb94729eb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:01 devstack sudo[92344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.2b148bc6-e6df-4113-add4-c7eeb94729eb
Nov 05 15:07:01 devstack sudo[92344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:01 devstack sudo[92344]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1432de73-f371-47fd-a2d7-1b082e93f08c tempest-GroupSnapshotsV319Test-1660474245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.2b148bc6-e6df-4113-add4-c7eeb94729eb" returned: 0 in 0.386s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:01 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-1432de73-f371-47fd-a2d7-1b082e93f08c tempest-GroupSnapshotsV319Test-1660474245 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.2b148bc6-e6df-4113-add4-c7eeb94729eb is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 15:07:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1432de73-f371-47fd-a2d7-1b082e93f08c tempest-GroupSnapshotsV319Test-1660474245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.2b148bc6-e6df-4113-add4-c7eeb94729eb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:01 devstack sudo[92367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.2b148bc6-e6df-4113-add4-c7eeb94729eb
Nov 05 15:07:01 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:01 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1432de73-f371-47fd-a2d7-1b082e93f08c tempest-GroupSnapshotsV319Test-1660474245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.2b148bc6-e6df-4113-add4-c7eeb94729eb" returned: 0 in 0.270s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1432de73-f371-47fd-a2d7-1b082e93f08c tempest-GroupSnapshotsV319Test-1660474245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:01 devstack sudo[92370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.info
Nov 05 15:07:01 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:02 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1432de73-f371-47fd-a2d7-1b082e93f08c tempest-GroupSnapshotsV319Test-1660474245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.info" returned: 0 in 0.254s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:02 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-1432de73-f371-47fd-a2d7-1b082e93f08c tempest-GroupSnapshotsV319Test-1660474245 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 15:07:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1432de73-f371-47fd-a2d7-1b082e93f08c tempest-GroupSnapshotsV319Test-1660474245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:02 devstack sudo[92373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.info
Nov 05 15:07:02 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:02 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1432de73-f371-47fd-a2d7-1b082e93f08c tempest-GroupSnapshotsV319Test-1660474245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.info" returned: 0 in 0.262s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1432de73-f371-47fd-a2d7-1b082e93f08c tempest-GroupSnapshotsV319Test-1660474245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.226s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:07:02 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1432de73-f371-47fd-a2d7-1b082e93f08c tempest-GroupSnapshotsV319Test-1660474245 None] group_snapshot bbe1c74c-cc81-40ec-a2db-bdfd48a45640: created successfully
Nov 05 15:07:04 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-7aee2d4d-c742-44ff-9309-5ab281eb4cbc req-763ee0ec-36b5-43d4-9cb1-b024ec2b1437 tempest-ServerActionsTestOtherA-844328353 None] Terminate volume connection completed successfully.
Nov 05 15:07:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-7aee2d4d-c742-44ff-9309-5ab281eb4cbc req-763ee0ec-36b5-43d4-9cb1-b024ec2b1437 tempest-ServerActionsTestOtherA-844328353 None] Deleting attachment 3934c028-d68e-432e-a5a5-ad0390444db7. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 15:07:04 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f920a7e4-6277-4ef6-94c7-a14d7797f355 tempest-GroupSnapshotsV319Test-1660474245 None] group_snapshot bbe1c74c-cc81-40ec-a2db-bdfd48a45640: deleting
Nov 05 15:07:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f920a7e4-6277-4ef6-94c7-a14d7797f355 tempest-GroupSnapshotsV319Test-1660474245 None] group_snapshot bbe1c74c-cc81-40ec-a2db-bdfd48a45640: deleting {{(pid=87150) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 15:07:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f920a7e4-6277-4ef6-94c7-a14d7797f355 tempest-GroupSnapshotsV319Test-1660474245 None] Acquiring lock "cinder-quobyte-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:07:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f920a7e4-6277-4ef6-94c7-a14d7797f355 tempest-GroupSnapshotsV319Test-1660474245 None] Lock "cinder-quobyte-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:07:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f920a7e4-6277-4ef6-94c7-a14d7797f355 tempest-GroupSnapshotsV319Test-1660474245 None] Acquiring lock "cinder-quobyte-2b148bc6-e6df-4113-add4-c7eeb94729eb" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:07:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f920a7e4-6277-4ef6-94c7-a14d7797f355 tempest-GroupSnapshotsV319Test-1660474245 None] Lock "cinder-quobyte-2b148bc6-e6df-4113-add4-c7eeb94729eb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:07:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-f920a7e4-6277-4ef6-94c7-a14d7797f355 tempest-GroupSnapshotsV319Test-1660474245 None] Deleting offline snapshot 2b148bc6-e6df-4113-add4-c7eeb94729eb of volume f3f6b7de-cc5d-46e8-b1e3-3987d12631a4 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:07:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-f920a7e4-6277-4ef6-94c7-a14d7797f355 tempest-GroupSnapshotsV319Test-1660474245 None] snapshot_file for this snap is: volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.2b148bc6-e6df-4113-add4-c7eeb94729eb {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:07:04 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[821befed-f73d-4e32-bc19-9946f42112e5]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:07:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f920a7e4-6277-4ef6-94c7-a14d7797f355 tempest-GroupSnapshotsV319Test-1660474245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.2b148bc6-e6df-4113-add4-c7eeb94729eb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:04 devstack sudo[92381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.2b148bc6-e6df-4113-add4-c7eeb94729eb
Nov 05 15:07:04 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:04 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f920a7e4-6277-4ef6-94c7-a14d7797f355 tempest-GroupSnapshotsV319Test-1660474245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.2b148bc6-e6df-4113-add4-c7eeb94729eb" returned: 0 in 0.414s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-f920a7e4-6277-4ef6-94c7-a14d7797f355 tempest-GroupSnapshotsV319Test-1660474245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:07:04 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00b2b7d-89a8-4f22-9b14-1b09f3ea0b98]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:07:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f920a7e4-6277-4ef6-94c7-a14d7797f355 tempest-GroupSnapshotsV319Test-1660474245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:04 devstack sudo[92388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4
Nov 05 15:07:04 devstack sudo[92388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:05 devstack sudo[92388]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f920a7e4-6277-4ef6-94c7-a14d7797f355 tempest-GroupSnapshotsV319Test-1660474245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4" returned: 0 in 0.562s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f920a7e4-6277-4ef6-94c7-a14d7797f355 tempest-GroupSnapshotsV319Test-1660474245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.2b148bc6-e6df-4113-add4-c7eeb94729eb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:05 devstack sudo[92411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.2b148bc6-e6df-4113-add4-c7eeb94729eb
Nov 05 15:07:05 devstack sudo[92411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:05 devstack sudo[92411]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f920a7e4-6277-4ef6-94c7-a14d7797f355 tempest-GroupSnapshotsV319Test-1660474245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.2b148bc6-e6df-4113-add4-c7eeb94729eb" returned: 0 in 0.466s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f920a7e4-6277-4ef6-94c7-a14d7797f355 tempest-GroupSnapshotsV319Test-1660474245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.2b148bc6-e6df-4113-add4-c7eeb94729eb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:05 devstack sudo[92423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.2b148bc6-e6df-4113-add4-c7eeb94729eb
Nov 05 15:07:05 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:06 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f920a7e4-6277-4ef6-94c7-a14d7797f355 tempest-GroupSnapshotsV319Test-1660474245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4.2b148bc6-e6df-4113-add4-c7eeb94729eb" returned: 0 in 0.329s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f920a7e4-6277-4ef6-94c7-a14d7797f355 tempest-GroupSnapshotsV319Test-1660474245 None] Lock "cinder-quobyte-2b148bc6-e6df-4113-add4-c7eeb94729eb" released by "_delete_snapshot" :: held 1.937s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:07:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f920a7e4-6277-4ef6-94c7-a14d7797f355 tempest-GroupSnapshotsV319Test-1660474245 None] Lock "cinder-quobyte-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4" released by "delete_snapshot" :: held 1.962s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:07:06 devstack cinder-volume[87150]: WARNING cinder.quota [None req-f920a7e4-6277-4ef6-94c7-a14d7797f355 tempest-GroupSnapshotsV319Test-1660474245 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-12959075 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-12959075, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:07:06 devstack cinder-volume[87150]: WARNING cinder.quota [None req-f920a7e4-6277-4ef6-94c7-a14d7797f355 tempest-GroupSnapshotsV319Test-1660474245 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-12959075 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-12959075, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:07:06 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-f920a7e4-6277-4ef6-94c7-a14d7797f355 tempest-GroupSnapshotsV319Test-1660474245 None] Created reservations ['62a3e13d-b666-4c61-a3e1-bef874ae94a1', '1378a1ad-e62e-4617-8213-a648d8140a89', '654f1809-44d8-40c7-af2e-9d79d5435cc4', '4e8c0e18-469a-43ad-9bc4-ea8dea19e57d'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:07:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f920a7e4-6277-4ef6-94c7-a14d7797f355 tempest-GroupSnapshotsV319Test-1660474245 None] group_snapshot bbe1c74c-cc81-40ec-a2db-bdfd48a45640: deleted successfully
Nov 05 15:07:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c651020b-4209-42f4-bb4e-8a04eb379d38 tempest-GroupSnapshotsV319Test-1660474245 None] Acquiring lock "cinder-quobyte-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:07:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c651020b-4209-42f4-bb4e-8a04eb379d38 tempest-GroupSnapshotsV319Test-1660474245 None] Lock "cinder-quobyte-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:07:06 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[11aed66d-4492-4bb5-9ced-7645b0172e56]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:07:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c651020b-4209-42f4-bb4e-8a04eb379d38 tempest-GroupSnapshotsV319Test-1660474245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:07 devstack sudo[92428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4
Nov 05 15:07:07 devstack sudo[92428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:07 devstack sudo[92428]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c651020b-4209-42f4-bb4e-8a04eb379d38 tempest-GroupSnapshotsV319Test-1660474245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4" returned: 0 in 0.460s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c651020b-4209-42f4-bb4e-8a04eb379d38 tempest-GroupSnapshotsV319Test-1660474245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:07 devstack sudo[92435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4
Nov 05 15:07:07 devstack sudo[92435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:07 devstack sudo[92435]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c651020b-4209-42f4-bb4e-8a04eb379d38 tempest-GroupSnapshotsV319Test-1660474245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4" returned: 0 in 0.330s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c651020b-4209-42f4-bb4e-8a04eb379d38 tempest-GroupSnapshotsV319Test-1660474245 None] Lock "cinder-quobyte-f3f6b7de-cc5d-46e8-b1e3-3987d12631a4" released by "delete_volume" :: held 0.892s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:07:07 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-c651020b-4209-42f4-bb4e-8a04eb379d38 tempest-GroupSnapshotsV319Test-1660474245 None] Created reservations ['c6662c93-7e9b-490c-847b-9292f37c03a9'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:07:07 devstack cinder-volume[87150]: WARNING cinder.quota [None req-c651020b-4209-42f4-bb4e-8a04eb379d38 tempest-GroupSnapshotsV319Test-1660474245 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-12959075 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-12959075, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:07:07 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-c651020b-4209-42f4-bb4e-8a04eb379d38 tempest-GroupSnapshotsV319Test-1660474245 None] Created reservations ['955568eb-acfd-413c-870b-87d821c8e8eb', '7575998a-21b6-440a-9787-cbeb3238a5da', 'f6558eaf-11bc-4b97-ab71-5550c4da5335', 'dade3feb-3e21-4f54-b8a2-bfeefce0be57'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:07:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c651020b-4209-42f4-bb4e-8a04eb379d38 tempest-GroupSnapshotsV319Test-1660474245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:07:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c651020b-4209-42f4-bb4e-8a04eb379d38 tempest-GroupSnapshotsV319Test-1660474245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:07:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c651020b-4209-42f4-bb4e-8a04eb379d38 tempest-GroupSnapshotsV319Test-1660474245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:07:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c651020b-4209-42f4-bb4e-8a04eb379d38 tempest-GroupSnapshotsV319Test-1660474245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:07:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c651020b-4209-42f4-bb4e-8a04eb379d38 tempest-GroupSnapshotsV319Test-1660474245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:07:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c651020b-4209-42f4-bb4e-8a04eb379d38 tempest-GroupSnapshotsV319Test-1660474245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:08 devstack sudo[92438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:07:08 devstack sudo[92438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:08 devstack sudo[92438]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c651020b-4209-42f4-bb4e-8a04eb379d38 tempest-GroupSnapshotsV319Test-1660474245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.362s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:08 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-c651020b-4209-42f4-bb4e-8a04eb379d38 tempest-GroupSnapshotsV319Test-1660474245 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:07:08 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c651020b-4209-42f4-bb4e-8a04eb379d38 tempest-GroupSnapshotsV319Test-1660474245 None] Delete group completed successfully.
Nov 05 15:07:12 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:07:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Flow 'volume_create_manager' (68fdf7bd-cd38-4280-beea-6ac79b2adfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:07:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ff8743-be64-4ee3-b0c5-7029fd2a68ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ff8743-be64-4ee3-b0c5-7029fd2a68ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-897863528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff130e2-7a9a-4455-9f97-2a3937082353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a47b61f05840fb8c946db2617d4869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:12Z,use_quota=True,user_id='575c9bc5765e4c1fbaa7650c1aa8898b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c78bec7-3690-4098-b7e6-732d52d6ec38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c78bec7-3690-4098-b7e6-732d52d6ec38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6fd1c4b-00eb-41dd-98d5-eedb5a89cea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:12 devstack cinder-volume[87150]: DEBUG cinder.image.glance [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Creating Keystone auth plugin from conf {{(pid=87150) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 15:07:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6fd1c4b-00eb-41dd-98d5-eedb5a89cea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cff130e2-7a9a-4455-9f97-2a3937082353', 'volume_name': 'volume-cff130e2-7a9a-4455-9f97-2a3937082353', 'volume_size': 1, 'image_id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4a6a2406cd83415e894eebbb1d6b51ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'created_at': datetime.datetime(2026, 11, 5, 13, 57, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21a5d804-2425-4adb-8e07-60d978b4be84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfad9136810>}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537b9a90-3f0e-496a-a274-829f3419ff0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537b9a90-3f0e-496a-a274-829f3419ff0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e1b90f7-9ce2-4fb1-bdc3-75f6008c1c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:13 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Volume cff130e2-7a9a-4455-9f97-2a3937082353: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cff130e2-7a9a-4455-9f97-2a3937082353', 'volume_size': 1, 'image_id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4a6a2406cd83415e894eebbb1d6b51ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'created_at': datetime.datetime(2026, 11, 5, 13, 57, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21a5d804-2425-4adb-8e07-60d978b4be84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfad9136810>}
Nov 05 15:07:13 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Trying to clone cff130e2-7a9a-4455-9f97-2a3937082353 from image 21a5d804-2425-4adb-8e07-60d978b4be84 at location (None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}]). {{(pid=87150) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Flow 'volume_create_manager' (d4e15aaf-a59f-4712-8fd6-186e66fb6133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0083bee9-92b0-49dc-b594-2221d4234c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0083bee9-92b0-49dc-b594-2221d4234c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-990656260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36b86e2-b77b-49b2-bb78-cbd1168eb63e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='083ea8321cdb43b795e21c65222a08be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:14Z,use_quota=True,user_id='fe921ee0e4b544cfa20be0b9f526254a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7fc1e8d-1404-4349-9bbd-a5d0d2c77e02),volume_type_id=b7fc1e8d-1404-4349-9bbd-a5d0d2c77e02)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a8f9e0-2f48-400c-839c-dd746d9288ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a8f9e0-2f48-400c-839c-dd746d9288ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ba3486-de61-465d-97f4-b579d89bebc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ba3486-de61-465d-97f4-b579d89bebc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f36b86e2-b77b-49b2-bb78-cbd1168eb63e', 'volume_name': 'volume-f36b86e2-b77b-49b2-bb78-cbd1168eb63e', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5530f2e2-9ecc-4b04-a176-672f815758aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5530f2e2-9ecc-4b04-a176-672f815758aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec387fd-55be-4237-bbeb-c7dcba91a156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:14 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Volume f36b86e2-b77b-49b2-bb78-cbd1168eb63e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f36b86e2-b77b-49b2-bb78-cbd1168eb63e', 'volume_size': 1}
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-990656260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36b86e2-b77b-49b2-bb78-cbd1168eb63e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='083ea8321cdb43b795e21c65222a08be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:14Z,use_quota=True,user_id='fe921ee0e4b544cfa20be0b9f526254a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7fc1e8d-1404-4349-9bbd-a5d0d2c77e02),volume_type_id=b7fc1e8d-1404-4349-9bbd-a5d0d2c77e02)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Creating volume f36b86e2-b77b-49b2-bb78-cbd1168eb63e {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:07:14 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f36b86e2-b77b-49b2-bb78-cbd1168eb63e 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:14 devstack sudo[92528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f36b86e2-b77b-49b2-bb78-cbd1168eb63e 1073741824
Nov 05 15:07:14 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_5o1ojtqwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 15:07:14 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0d8f87-5968-4fe6-bcf4-8dbfb9ac8519]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:07:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_5o1ojtqwdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:14 devstack sudo[92530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_5o1ojtqwdevstack@QuobyteHD
Nov 05 15:07:14 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:15 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_5o1ojtqwdevstack@QuobyteHD" returned: 0 in 0.496s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Temporary image 21a5d804-2425-4adb-8e07-60d978b4be84 is fetched for user 575c9bc5765e4c1fbaa7650c1aa8898b. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 15:07:15 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f36b86e2-b77b-49b2-bb78-cbd1168eb63e 1073741824" returned: 0 in 0.715s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6d48d3-793e-45ec-ad26-b71e724a9f14]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_5o1ojtqwdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f36b86e2-b77b-49b2-bb78-cbd1168eb63e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:15 devstack sudo[92542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f36b86e2-b77b-49b2-bb78-cbd1168eb63e
Nov 05 15:07:15 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:15 devstack sudo[92541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_5o1ojtqwdevstack@QuobyteHD
Nov 05 15:07:15 devstack sudo[92541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:15 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f36b86e2-b77b-49b2-bb78-cbd1168eb63e" returned: 0 in 0.298s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec387fd-55be-4237-bbeb-c7dcba91a156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f36b86e2-b77b-49b2-bb78-cbd1168eb63e', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80977d96-02ec-4619-a171-73be567d9e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:15 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Volume volume-f36b86e2-b77b-49b2-bb78-cbd1168eb63e (f36b86e2-b77b-49b2-bb78-cbd1168eb63e): created successfully
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80977d96-02ec-4619-a171-73be567d9e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Flow 'volume_create_manager' (d4e15aaf-a59f-4712-8fd6-186e66fb6133) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:07:15 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d65bcf7f-c694-430b-8b3a-d7557ab7a981 tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Created volume successfully.
Nov 05 15:07:15 devstack sudo[92541]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_5o1ojtqwdevstack@QuobyteHD" returned: 0 in 0.472s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-897863528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff130e2-7a9a-4455-9f97-2a3937082353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a47b61f05840fb8c946db2617d4869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:12Z,use_quota=True,user_id='575c9bc5765e4c1fbaa7650c1aa8898b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Creating volume cff130e2-7a9a-4455-9f97-2a3937082353 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:07:15 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:07:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cff130e2-7a9a-4455-9f97-2a3937082353 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:15 devstack sudo[92549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cff130e2-7a9a-4455-9f97-2a3937082353 1073741824
Nov 05 15:07:15 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:16 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cff130e2-7a9a-4455-9f97-2a3937082353 1073741824" returned: 0 in 0.517s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cff130e2-7a9a-4455-9f97-2a3937082353 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:16 devstack sudo[92555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cff130e2-7a9a-4455-9f97-2a3937082353
Nov 05 15:07:16 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:16 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cff130e2-7a9a-4455-9f97-2a3937082353" returned: 0 in 0.296s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:07:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:07:16 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Attempting download of 21a5d804-2425-4adb-8e07-60d978b4be84 ((None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}])) to volume cff130e2-7a9a-4455-9f97-2a3937082353. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 15:07:16 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b767ab-5495-46c3-b906-b0104bf93b66]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:07:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_kjd94ocs {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:17 devstack sudo[92558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_kjd94ocs
Nov 05 15:07:17 devstack sudo[92558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-08761dc3-4397-4a94-a115-2d931d9944cb tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:07:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-08761dc3-4397-4a94-a115-2d931d9944cb tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:07:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-08761dc3-4397-4a94-a115-2d931d9944cb tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:07:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-08761dc3-4397-4a94-a115-2d931d9944cb tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:07:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-08761dc3-4397-4a94-a115-2d931d9944cb tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:07:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-08761dc3-4397-4a94-a115-2d931d9944cb tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:17 devstack sudo[92560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:07:17 devstack sudo[92560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:17 devstack sudo[92558]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_kjd94ocs" returned: 0 in 0.479s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_kjd94ocs {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:17 devstack sudo[92560]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-08761dc3-4397-4a94-a115-2d931d9944cb tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.320s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:17 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-08761dc3-4397-4a94-a115-2d931d9944cb tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:07:17 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-08761dc3-4397-4a94-a115-2d931d9944cb tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Retype volume completed successfully.
Nov 05 15:07:17 devstack sudo[92565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_kjd94ocs
Nov 05 15:07:17 devstack sudo[92565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:17 devstack sudo[92565]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_kjd94ocs" returned: 1 in 0.374s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_kjd94ocs' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 15:07:17 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5ca93d-38c6-4a6a-80bf-10c21f751ffc]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:07:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_5o1ojtqwdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:17 devstack sudo[92571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_5o1ojtqwdevstack@QuobyteHD
Nov 05 15:07:17 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:18 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_5o1ojtqwdevstack@QuobyteHD" returned: 0 in 0.485s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:18 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] 21a5d804-2425-4adb-8e07-60d978b4be84 was qcow2, converting to qcow2 {{(pid=87150) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 15:07:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_5o1ojtqwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cff130e2-7a9a-4455-9f97-2a3937082353 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:18 devstack sudo[92578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_5o1ojtqwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cff130e2-7a9a-4455-9f97-2a3937082353
Nov 05 15:07:18 devstack sudo[92578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-fd9f02b5-feb1-4878-99fc-1a047fe95223 req-d44bdf0e-188f-4621-a72a-981c89e4e9b2 tempest-AttachVolumeNegativeTest-1140258724 None] Terminate volume connection completed successfully.
Nov 05 15:07:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-fd9f02b5-feb1-4878-99fc-1a047fe95223 req-d44bdf0e-188f-4621-a72a-981c89e4e9b2 tempest-AttachVolumeNegativeTest-1140258724 None] Deleting attachment 9ee59a63-3c4a-48c7-bbe3-28528f6becd1. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 15:07:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1ba3eab9-e514-45e4-ab3e-acc226c6a06e tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Acquiring lock "cinder-f36b86e2-b77b-49b2-bb78-cbd1168eb63e-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:07:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1ba3eab9-e514-45e4-ab3e-acc226c6a06e tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Lock "cinder-f36b86e2-b77b-49b2-bb78-cbd1168eb63e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:07:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1ba3eab9-e514-45e4-ab3e-acc226c6a06e tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Acquiring lock "cinder-quobyte-f36b86e2-b77b-49b2-bb78-cbd1168eb63e" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:07:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1ba3eab9-e514-45e4-ab3e-acc226c6a06e tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Lock "cinder-quobyte-f36b86e2-b77b-49b2-bb78-cbd1168eb63e" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:07:18 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[836f9599-1a79-4cfe-b4fd-08c6570caf97]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:07:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ba3eab9-e514-45e4-ab3e-acc226c6a06e tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f36b86e2-b77b-49b2-bb78-cbd1168eb63e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:18 devstack sudo[92588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f36b86e2-b77b-49b2-bb78-cbd1168eb63e
Nov 05 15:07:18 devstack sudo[92588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:19 devstack sudo[92588]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ba3eab9-e514-45e4-ab3e-acc226c6a06e tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f36b86e2-b77b-49b2-bb78-cbd1168eb63e" returned: 0 in 0.488s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ba3eab9-e514-45e4-ab3e-acc226c6a06e tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f36b86e2-b77b-49b2-bb78-cbd1168eb63e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:19 devstack sudo[92602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f36b86e2-b77b-49b2-bb78-cbd1168eb63e
Nov 05 15:07:19 devstack sudo[92602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:19 devstack sudo[92602]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ba3eab9-e514-45e4-ab3e-acc226c6a06e tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f36b86e2-b77b-49b2-bb78-cbd1168eb63e" returned: 0 in 0.415s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1ba3eab9-e514-45e4-ab3e-acc226c6a06e tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Lock "cinder-quobyte-f36b86e2-b77b-49b2-bb78-cbd1168eb63e" released by "delete_volume" :: held 0.968s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:07:19 devstack cinder-volume[87150]: WARNING cinder.quota [None req-1ba3eab9-e514-45e4-ab3e-acc226c6a06e tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:07:19 devstack cinder-volume[87150]: WARNING cinder.quota [None req-1ba3eab9-e514-45e4-ab3e-acc226c6a06e tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:07:19 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-1ba3eab9-e514-45e4-ab3e-acc226c6a06e tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Created reservations ['86d27eef-2b18-41a0-9dbd-99a30f6651a9', '04e5980a-81a7-443a-a348-a5efa8f51406', '9af62a56-e8b5-4df5-934d-3e15e0b8098a', '7ed320e5-ae34-4ea0-a6c9-9d03dcc94730'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:07:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1ba3eab9-e514-45e4-ab3e-acc226c6a06e tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:07:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1ba3eab9-e514-45e4-ab3e-acc226c6a06e tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:07:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1ba3eab9-e514-45e4-ab3e-acc226c6a06e tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:07:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1ba3eab9-e514-45e4-ab3e-acc226c6a06e tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:07:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1ba3eab9-e514-45e4-ab3e-acc226c6a06e tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:07:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ba3eab9-e514-45e4-ab3e-acc226c6a06e tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:20 devstack sudo[92622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:07:20 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:20 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ba3eab9-e514-45e4-ab3e-acc226c6a06e tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.535s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:20 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-1ba3eab9-e514-45e4-ab3e-acc226c6a06e tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:07:20 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1ba3eab9-e514-45e4-ab3e-acc226c6a06e tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Deleted volume successfully.
Nov 05 15:07:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1ba3eab9-e514-45e4-ab3e-acc226c6a06e tempest-VolumeRetypeWithoutMigrationTest-1019098122 None] Lock "cinder-f36b86e2-b77b-49b2-bb78-cbd1168eb63e-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:07:21 devstack sudo[92578]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_5o1ojtqwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cff130e2-7a9a-4455-9f97-2a3937082353" returned: 0 in 3.050s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:21 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_5o1ojtqwdevstack@QuobyteHD, size 112.00 MB, duration 3.05 sec, destination /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cff130e2-7a9a-4455-9f97-2a3937082353 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:07:21 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Converted 112.00 MB image at 36.71 MB/s
Nov 05 15:07:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cff130e2-7a9a-4455-9f97-2a3937082353 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:21 devstack sudo[92635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cff130e2-7a9a-4455-9f97-2a3937082353 1G
Nov 05 15:07:21 devstack sudo[92635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:21 devstack sudo[92635]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cff130e2-7a9a-4455-9f97-2a3937082353 1G" returned: 0 in 0.578s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:21 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Downloaded image 21a5d804-2425-4adb-8e07-60d978b4be84 ((None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}])) to volume cff130e2-7a9a-4455-9f97-2a3937082353 successfully. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 15:07:21 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Temporary image 21a5d804-2425-4adb-8e07-60d978b4be84 for user 575c9bc5765e4c1fbaa7650c1aa8898b is deleted. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 15:07:21 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Marking volume cff130e2-7a9a-4455-9f97-2a3937082353 as bootable. {{(pid=87150) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 15:07:21 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Copying metadata from image 21a5d804-2425-4adb-8e07-60d978b4be84 to cff130e2-7a9a-4455-9f97-2a3937082353. {{(pid=87150) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 15:07:21 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Creating volume glance metadata for volume cff130e2-7a9a-4455-9f97-2a3937082353 backed by image 21a5d804-2425-4adb-8e07-60d978b4be84 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87150) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 15:07:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e1b90f7-9ce2-4fb1-bdc3-75f6008c1c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cff130e2-7a9a-4455-9f97-2a3937082353', 'volume_size': 1, 'image_id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4a6a2406cd83415e894eebbb1d6b51ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'created_at': datetime.datetime(2026, 11, 5, 13, 57, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21a5d804-2425-4adb-8e07-60d978b4be84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfad9136810>}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fff8e73-aa09-4a50-b97c-72254a63c1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:22 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Volume volume-cff130e2-7a9a-4455-9f97-2a3937082353 (cff130e2-7a9a-4455-9f97-2a3937082353): created successfully
Nov 05 15:07:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fff8e73-aa09-4a50-b97c-72254a63c1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Flow 'volume_create_manager' (68fdf7bd-cd38-4280-beea-6ac79b2adfc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:07:22 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3322a056-d02b-4ace-870a-e5a784aba3fe tempest-ServerActionsTestOtherA-844328353 None] Created volume successfully.
Nov 05 15:07:25 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b53ab909-88a0-40c3-accc-29cc9bfdd4a6 tempest-GroupsTest-1900800888 None] Group tempest-Group1-305430523: creating
Nov 05 15:07:25 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b53ab909-88a0-40c3-accc-29cc9bfdd4a6 tempest-GroupsTest-1900800888 None] Group tempest-Group1-305430523: created successfully
Nov 05 15:07:25 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b53ab909-88a0-40c3-accc-29cc9bfdd4a6 tempest-GroupsTest-1900800888 None] Create group completed successfully.
Nov 05 15:07:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-f7637868-1541-4c91-8457-f36e72bf870c req-9428f015-0a7c-4c6a-8efa-573922a42fe0 tempest-ServerActionsTestOtherA-844328353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:07:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-f7637868-1541-4c91-8457-f36e72bf870c req-9428f015-0a7c-4c6a-8efa-573922a42fe0 tempest-ServerActionsTestOtherA-844328353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:07:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-f7637868-1541-4c91-8457-f36e72bf870c req-9428f015-0a7c-4c6a-8efa-573922a42fe0 tempest-ServerActionsTestOtherA-844328353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:07:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-42348582-6f79-40ec-9ff7-87a1d77b3eb3 tempest-GroupsTest-1900800888 None] Group tempest-Group2-1070116176: creating
Nov 05 15:07:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-f7637868-1541-4c91-8457-f36e72bf870c req-9428f015-0a7c-4c6a-8efa-573922a42fe0 tempest-ServerActionsTestOtherA-844328353 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628', 'name': 'volume-cff130e2-7a9a-4455-9f97-2a3937082353', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fdf1ccd7-bd5a-43ac-ac54-d94d09c7c8c8', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 15:07:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-42348582-6f79-40ec-9ff7-87a1d77b3eb3 tempest-GroupsTest-1900800888 None] Group tempest-Group2-1070116176: created successfully
Nov 05 15:07:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-42348582-6f79-40ec-9ff7-87a1d77b3eb3 tempest-GroupsTest-1900800888 None] Create group completed successfully.
Nov 05 15:07:27 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-f7637868-1541-4c91-8457-f36e72bf870c req-9428f015-0a7c-4c6a-8efa-573922a42fe0 tempest-ServerActionsTestOtherA-844328353 None] attachment_update completed successfully.
Nov 05 15:07:28 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:07:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Flow 'volume_create_manager' (73f5d7f9-6084-4f88-af30-e09eaeaf8cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:07:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e59351-4ed2-4ecb-83cc-5ad69ac8a4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e59351-4ed2-4ecb-83cc-5ad69ac8a4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2138229368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ef3b4adb-f03d-49c2-8f5a-562939d7c70b,host='devstack@QuobyteHD#QuobyteHD',id=747ad3f7-484f-409a-8eb9-b50d77cad090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e563db116934604a856c3bbdf5f541c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:29Z,use_quota=True,user_id='02a46074bffe40a48d7d121649e91f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(726905e2-c957-4fc5-8c39-bf447c11184f),volume_type_id=726905e2-c957-4fc5-8c39-bf447c11184f)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1175921c-cd6e-4ef2-b1f7-10b7dac72587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1175921c-cd6e-4ef2-b1f7-10b7dac72587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67af919-c1b6-4266-a1b2-5727b3037978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67af919-c1b6-4266-a1b2-5727b3037978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '747ad3f7-484f-409a-8eb9-b50d77cad090', 'volume_name': 'volume-747ad3f7-484f-409a-8eb9-b50d77cad090', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d8a64e-abd9-4522-b9b2-eb54046ab6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d8a64e-abd9-4522-b9b2-eb54046ab6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9901543f-dfab-4649-93a8-9ff349a66bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:28 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Volume 747ad3f7-484f-409a-8eb9-b50d77cad090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-747ad3f7-484f-409a-8eb9-b50d77cad090', 'volume_size': 1}
Nov 05 15:07:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:07:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:07:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ef3b4adb-f03d-49c2-8f5a-562939d7c70b,created_at=2026-11-05T14:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2138229368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ef3b4adb-f03d-49c2-8f5a-562939d7c70b,host='devstack@QuobyteHD#QuobyteHD',id=747ad3f7-484f-409a-8eb9-b50d77cad090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e563db116934604a856c3bbdf5f541c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:29Z,use_quota=True,user_id='02a46074bffe40a48d7d121649e91f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(726905e2-c957-4fc5-8c39-bf447c11184f),volume_type_id=726905e2-c957-4fc5-8c39-bf447c11184f)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:07:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Creating volume 747ad3f7-484f-409a-8eb9-b50d77cad090 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:07:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:07:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:07:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:07:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:07:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:07:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:07:28 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:07:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-747ad3f7-484f-409a-8eb9-b50d77cad090 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:29 devstack sudo[92668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-747ad3f7-484f-409a-8eb9-b50d77cad090 1073741824
Nov 05 15:07:29 devstack sudo[92668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:29 devstack sudo[92668]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-747ad3f7-484f-409a-8eb9-b50d77cad090 1073741824" returned: 0 in 0.638s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-747ad3f7-484f-409a-8eb9-b50d77cad090 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:29 devstack sudo[92675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-747ad3f7-484f-409a-8eb9-b50d77cad090
Nov 05 15:07:29 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:30 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-747ad3f7-484f-409a-8eb9-b50d77cad090" returned: 0 in 0.493s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:07:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:07:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9901543f-dfab-4649-93a8-9ff349a66bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-747ad3f7-484f-409a-8eb9-b50d77cad090', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e43018-8ee1-4f48-af6f-d8cbde6bc823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:30 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Volume volume-747ad3f7-484f-409a-8eb9-b50d77cad090 (747ad3f7-484f-409a-8eb9-b50d77cad090): created successfully
Nov 05 15:07:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e43018-8ee1-4f48-af6f-d8cbde6bc823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Flow 'volume_create_manager' (73f5d7f9-6084-4f88-af30-e09eaeaf8cf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:07:30 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-228fb9af-c723-449e-92d9-dbf6b93b9ffe tempest-GroupsTest-1900800888 None] Created volume successfully.
Nov 05 15:07:32 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:07:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Flow 'volume_create_manager' (6cb09c76-62ac-4a21-8317-f3698c48e4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:07:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5611eee8-ff0d-48a3-8ea6-d2cdc8aa9764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5611eee8-ff0d-48a3-8ea6-d2cdc8aa9764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1987055697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=421ff259-511b-4737-bfc1-e991644ccd4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe9d510fd9a48e18d66b1f001a906b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:32Z,use_quota=True,user_id='e07c94fc9e274ad387cd6edf0ff7385d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d368c681-e5ed-465c-a9ae-59e31fdfd636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d368c681-e5ed-465c-a9ae-59e31fdfd636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7c1df9-aedf-406e-963e-6beebe47d03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7c1df9-aedf-406e-963e-6beebe47d03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '421ff259-511b-4737-bfc1-e991644ccd4d', 'volume_name': 'volume-421ff259-511b-4737-bfc1-e991644ccd4d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6cb230-c51a-436a-a13d-189eb6f3bf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6cb230-c51a-436a-a13d-189eb6f3bf8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a768d801-7dd1-4d5d-bc1d-c1692505f0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:32 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Volume 421ff259-511b-4737-bfc1-e991644ccd4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-421ff259-511b-4737-bfc1-e991644ccd4d', 'volume_size': 1}
Nov 05 15:07:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:07:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:07:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1987055697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=421ff259-511b-4737-bfc1-e991644ccd4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe9d510fd9a48e18d66b1f001a906b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:32Z,use_quota=True,user_id='e07c94fc9e274ad387cd6edf0ff7385d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:07:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Creating volume 421ff259-511b-4737-bfc1-e991644ccd4d {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:07:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:07:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:07:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:07:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:07:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:07:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:07:32 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:07:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:32 devstack sudo[93137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d 1073741824
Nov 05 15:07:32 devstack sudo[93137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fffcd973-4806-4f00-8c41-fd4388947044 tempest-GroupsTest-1900800888 None] Acquiring lock "cinder-quobyte-747ad3f7-484f-409a-8eb9-b50d77cad090" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:07:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fffcd973-4806-4f00-8c41-fd4388947044 tempest-GroupsTest-1900800888 None] Lock "cinder-quobyte-747ad3f7-484f-409a-8eb9-b50d77cad090" acquired by "delete_volume" :: waited 0.060s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:07:33 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c204ad48-68ad-4b1a-b983-cd30143d3a82]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:07:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fffcd973-4806-4f00-8c41-fd4388947044 tempest-GroupsTest-1900800888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-747ad3f7-484f-409a-8eb9-b50d77cad090 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:33 devstack sudo[93142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-747ad3f7-484f-409a-8eb9-b50d77cad090
Nov 05 15:07:33 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:33 devstack sudo[93137]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d 1073741824" returned: 0 in 1.214s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:33 devstack sudo[93158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d
Nov 05 15:07:33 devstack sudo[93158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:34 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fffcd973-4806-4f00-8c41-fd4388947044 tempest-GroupsTest-1900800888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-747ad3f7-484f-409a-8eb9-b50d77cad090" returned: 0 in 1.050s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fffcd973-4806-4f00-8c41-fd4388947044 tempest-GroupsTest-1900800888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-747ad3f7-484f-409a-8eb9-b50d77cad090 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:34 devstack sudo[93165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-747ad3f7-484f-409a-8eb9-b50d77cad090
Nov 05 15:07:34 devstack sudo[93165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:34 devstack sudo[93158]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d" returned: 0 in 0.579s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] <== create_volume: return (1976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:07:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:07:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a768d801-7dd1-4d5d-bc1d-c1692505f0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-421ff259-511b-4737-bfc1-e991644ccd4d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221eae67-665a-4906-bec0-c02bbc55e8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:34 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Volume volume-421ff259-511b-4737-bfc1-e991644ccd4d (421ff259-511b-4737-bfc1-e991644ccd4d): created successfully
Nov 05 15:07:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221eae67-665a-4906-bec0-c02bbc55e8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Flow 'volume_create_manager' (6cb09c76-62ac-4a21-8317-f3698c48e4b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:07:34 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-de5c9f62-c115-4f79-8c0a-c9667bccd9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Created volume successfully.
Nov 05 15:07:34 devstack sudo[93165]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fffcd973-4806-4f00-8c41-fd4388947044 tempest-GroupsTest-1900800888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-747ad3f7-484f-409a-8eb9-b50d77cad090" returned: 0 in 0.606s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fffcd973-4806-4f00-8c41-fd4388947044 tempest-GroupsTest-1900800888 None] Lock "cinder-quobyte-747ad3f7-484f-409a-8eb9-b50d77cad090" released by "delete_volume" :: held 1.807s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:07:34 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-fffcd973-4806-4f00-8c41-fd4388947044 tempest-GroupsTest-1900800888 None] Created reservations ['d058b308-a61c-4269-aaa0-26d499987a9e'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:07:34 devstack cinder-volume[87150]: WARNING cinder.quota [None req-fffcd973-4806-4f00-8c41-fd4388947044 tempest-GroupsTest-1900800888 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1278628950 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1278628950, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:07:34 devstack cinder-volume[87150]: WARNING cinder.quota [None req-fffcd973-4806-4f00-8c41-fd4388947044 tempest-GroupsTest-1900800888 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1278628950 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1278628950, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:07:34 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-fffcd973-4806-4f00-8c41-fd4388947044 tempest-GroupsTest-1900800888 None] Created reservations ['bbbf9a0f-0c05-4871-978b-13f6f6357ba1', '2f9b484e-566e-4b74-80eb-73e5f7ffb810', '0a321ea0-e49f-4bda-b170-432695b83e14', '82d08ced-0feb-4226-9220-6a5cf6c7c8c9'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:07:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fffcd973-4806-4f00-8c41-fd4388947044 tempest-GroupsTest-1900800888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:07:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fffcd973-4806-4f00-8c41-fd4388947044 tempest-GroupsTest-1900800888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:07:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fffcd973-4806-4f00-8c41-fd4388947044 tempest-GroupsTest-1900800888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:07:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fffcd973-4806-4f00-8c41-fd4388947044 tempest-GroupsTest-1900800888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:07:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fffcd973-4806-4f00-8c41-fd4388947044 tempest-GroupsTest-1900800888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:07:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fffcd973-4806-4f00-8c41-fd4388947044 tempest-GroupsTest-1900800888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:35 devstack sudo[93172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:07:35 devstack sudo[93172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:35 devstack sudo[93172]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fffcd973-4806-4f00-8c41-fd4388947044 tempest-GroupsTest-1900800888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.429s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:35 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-fffcd973-4806-4f00-8c41-fd4388947044 tempest-GroupsTest-1900800888 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:07:35 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-fffcd973-4806-4f00-8c41-fd4388947044 tempest-GroupsTest-1900800888 None] Delete group completed successfully.
Nov 05 15:07:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ef457746-6239-44b5-b8ee-9f1d8ec5aacd tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:07:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ef457746-6239-44b5-b8ee-9f1d8ec5aacd tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:07:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ef457746-6239-44b5-b8ee-9f1d8ec5aacd tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Creating offline snapshot 0e7c20dc-5e92-40cd-a0eb-e25902c8044f of volume 421ff259-511b-4737-bfc1-e991644ccd4d {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:07:36 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d26a16-b3c9-499d-bc2f-f3c9811973ca]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:07:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ef457746-6239-44b5-b8ee-9f1d8ec5aacd tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:36 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-31d32151-2b43-4d14-944c-65faf8de5219 tempest-GroupsTest-1900800888 None] Created reservations ['b9da9c46-f6e4-42c9-b88f-ade872de8175'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:07:36 devstack sudo[93178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d
Nov 05 15:07:36 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-31d32151-2b43-4d14-944c-65faf8de5219 tempest-GroupsTest-1900800888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:07:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-31d32151-2b43-4d14-944c-65faf8de5219 tempest-GroupsTest-1900800888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:07:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-31d32151-2b43-4d14-944c-65faf8de5219 tempest-GroupsTest-1900800888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:07:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-31d32151-2b43-4d14-944c-65faf8de5219 tempest-GroupsTest-1900800888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:07:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-31d32151-2b43-4d14-944c-65faf8de5219 tempest-GroupsTest-1900800888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:07:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-31d32151-2b43-4d14-944c-65faf8de5219 tempest-GroupsTest-1900800888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:36 devstack sudo[93181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:07:36 devstack sudo[93181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:37 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ef457746-6239-44b5-b8ee-9f1d8ec5aacd tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d" returned: 0 in 0.670s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ef457746-6239-44b5-b8ee-9f1d8ec5aacd tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.0e7c20dc-5e92-40cd-a0eb-e25902c8044f 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:37 devstack sudo[93181]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-31d32151-2b43-4d14-944c-65faf8de5219 tempest-GroupsTest-1900800888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.462s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-31d32151-2b43-4d14-944c-65faf8de5219 tempest-GroupsTest-1900800888 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:07:37 devstack sudo[93188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.0e7c20dc-5e92-40cd-a0eb-e25902c8044f 1G
Nov 05 15:07:37 devstack sudo[93188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:37 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-31d32151-2b43-4d14-944c-65faf8de5219 tempest-GroupsTest-1900800888 None] Delete group completed successfully.
Nov 05 15:07:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:07:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:07:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:07:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:07:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:07:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:07:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:37 devstack sudo[93190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:07:37 devstack sudo[93190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:37 devstack sudo[93190]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.572s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:07:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:07:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 15:07:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread info: [<_MainThread(MainThread, started 136317437956224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136317326340928)>, <Thread(Thread-3 (stat_writer), started daemon 136317326487936)>, <Thread(Rabbit-heartbeat, started daemon 136317321464000)>, <Thread(Thread-5 (_runner), started daemon 136317321550592)>, <Thread(Thread-7 (_runner), started daemon 136317321658496)>, <Thread(fd_logger, started daemon 136317319612992)>, <Thread(privsep_reader, started daemon 136317319622400)>, <Thread(tpool_thread_0, started daemon 136317310928576)>, <Thread(tpool_thread_1, started daemon 136317302535872)>, <Thread(tpool_thread_2, started daemon 136317294143168)>, <Thread(tpool_thread_3, started daemon 136317285750464)>, <Thread(tpool_thread_4, started daemon 136317277357760)>, <Thread(tpool_thread_5, started daemon 136317268965056)>, <Thread(tpool_thread_6, started daemon 136317260572352)>, <Thread(tpool_thread_7, started daemon 136317252179648)>, <Thread(tpool_thread_8, started daemon 136317243786944)>, <Thread(tpool_thread_9, started daemon 136317235394240)>, <Thread(tpool_thread_10, started daemon 136317227001536)>, <Thread(tpool_thread_11, started daemon 136317218608832)>, <Thread(tpool_thread_12, started daemon 136317210216128)>, <Thread(tpool_thread_13, started daemon 136317201807040)>, <Thread(tpool_thread_14, started daemon 136317193397952)>, <Thread(tpool_thread_15, started daemon 136317184988864)>, <Thread(tpool_thread_16, started daemon 136317176579776)>, <Thread(tpool_thread_17, started daemon 136317168170688)>, <Thread(tpool_thread_18, started daemon 136317159761600)>, <Thread(tpool_thread_19, started daemon 136317151352512)>] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 15:07:38 devstack sudo[93188]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ef457746-6239-44b5-b8ee-9f1d8ec5aacd tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.0e7c20dc-5e92-40cd-a0eb-e25902c8044f 1G" returned: 0 in 1.123s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ef457746-6239-44b5-b8ee-9f1d8ec5aacd tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-421ff259-511b-4737-bfc1-e991644ccd4d -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.0e7c20dc-5e92-40cd-a0eb-e25902c8044f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:38 devstack sudo[93197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-421ff259-511b-4737-bfc1-e991644ccd4d -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.0e7c20dc-5e92-40cd-a0eb-e25902c8044f
Nov 05 15:07:38 devstack sudo[93197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:38 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=115,cinder:INSERT=28,cinder:UPDATE=87,cinder:DELETE=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:07:38 devstack sudo[93197]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ef457746-6239-44b5-b8ee-9f1d8ec5aacd tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-421ff259-511b-4737-bfc1-e991644ccd4d -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.0e7c20dc-5e92-40cd-a0eb-e25902c8044f" returned: 0 in 0.824s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:39 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-ef457746-6239-44b5-b8ee-9f1d8ec5aacd tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.0e7c20dc-5e92-40cd-a0eb-e25902c8044f is being set with open permissions: ugo+rw
Nov 05 15:07:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ef457746-6239-44b5-b8ee-9f1d8ec5aacd tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.0e7c20dc-5e92-40cd-a0eb-e25902c8044f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:39 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-54feec46-f4b6-4e23-a4a8-8f99bec8b911 tempest-GroupsTest-1900800888 None] Group tempest-GroupsTest-Group-2113133801: creating
Nov 05 15:07:39 devstack sudo[93224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.0e7c20dc-5e92-40cd-a0eb-e25902c8044f
Nov 05 15:07:39 devstack sudo[93224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:39 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=94,cinder:DELETE=6,cinder:SELECT=99,cinder:INSERT=22 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:07:39 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-54feec46-f4b6-4e23-a4a8-8f99bec8b911 tempest-GroupsTest-1900800888 None] Group tempest-GroupsTest-Group-2113133801: created successfully
Nov 05 15:07:39 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-54feec46-f4b6-4e23-a4a8-8f99bec8b911 tempest-GroupsTest-1900800888 None] Create group completed successfully.
Nov 05 15:07:39 devstack sudo[93224]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ef457746-6239-44b5-b8ee-9f1d8ec5aacd tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.0e7c20dc-5e92-40cd-a0eb-e25902c8044f" returned: 0 in 0.711s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ef457746-6239-44b5-b8ee-9f1d8ec5aacd tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:39 devstack sudo[93262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.info
Nov 05 15:07:39 devstack sudo[93262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:40 devstack sudo[93262]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ef457746-6239-44b5-b8ee-9f1d8ec5aacd tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.info" returned: 0 in 0.820s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:40 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-ef457746-6239-44b5-b8ee-9f1d8ec5aacd tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.info is being set with open permissions: ugo+rw
Nov 05 15:07:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ef457746-6239-44b5-b8ee-9f1d8ec5aacd tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:40 devstack sudo[93276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.info
Nov 05 15:07:40 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:41 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ef457746-6239-44b5-b8ee-9f1d8ec5aacd tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.info" returned: 0 in 0.920s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ef457746-6239-44b5-b8ee-9f1d8ec5aacd tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.432s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:07:41 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ef457746-6239-44b5-b8ee-9f1d8ec5aacd tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Create snapshot completed successfully
Nov 05 15:07:42 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:07:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Flow 'volume_create_manager' (8b05350e-bbfb-4bcc-ad00-e671197666df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:07:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59faa5a8-1abb-4856-ba43-8b85339f3c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59faa5a8-1abb-4856-ba43-8b85339f3c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1029954551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c19e1d53-93cd-4370-8fac-dca6aa571262,host='devstack@QuobyteHD#QuobyteHD',id=36a57785-8e83-4716-9189-93bbdaf454b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e563db116934604a856c3bbdf5f541c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:42Z,use_quota=True,user_id='02a46074bffe40a48d7d121649e91f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65dbfbd6-cdd0-4917-bceb-5f795eb91dd1),volume_type_id=65dbfbd6-cdd0-4917-bceb-5f795eb91dd1)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5cbbbc1-0935-46a8-ad39-ac13efe5312a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5cbbbc1-0935-46a8-ad39-ac13efe5312a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc0febf-517d-4428-a9a4-762944672a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc0febf-517d-4428-a9a4-762944672a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36a57785-8e83-4716-9189-93bbdaf454b7', 'volume_name': 'volume-36a57785-8e83-4716-9189-93bbdaf454b7', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (728d75e0-f658-421c-affb-e0f2325e426e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (728d75e0-f658-421c-affb-e0f2325e426e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b882c89f-5c65-41d2-b6bd-80f7a1bf99f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:42 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Volume 36a57785-8e83-4716-9189-93bbdaf454b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36a57785-8e83-4716-9189-93bbdaf454b7', 'volume_size': 1}
Nov 05 15:07:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:07:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:07:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c19e1d53-93cd-4370-8fac-dca6aa571262,created_at=2026-11-05T14:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1029954551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c19e1d53-93cd-4370-8fac-dca6aa571262,host='devstack@QuobyteHD#QuobyteHD',id=36a57785-8e83-4716-9189-93bbdaf454b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e563db116934604a856c3bbdf5f541c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:42Z,use_quota=True,user_id='02a46074bffe40a48d7d121649e91f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65dbfbd6-cdd0-4917-bceb-5f795eb91dd1),volume_type_id=65dbfbd6-cdd0-4917-bceb-5f795eb91dd1)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:07:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Creating volume 36a57785-8e83-4716-9189-93bbdaf454b7 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:07:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:07:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:07:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:07:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:07:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:07:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:07:42 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:07:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-36a57785-8e83-4716-9189-93bbdaf454b7 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:42 devstack sudo[93285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-36a57785-8e83-4716-9189-93bbdaf454b7 1073741824
Nov 05 15:07:42 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:43 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-36a57785-8e83-4716-9189-93bbdaf454b7 1073741824" returned: 0 in 1.205s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b7c57c1b-2a76-4e14-93e3-237868ffe8f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Acquiring lock "cinder-0e7c20dc-5e92-40cd-a0eb-e25902c8044f-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:07:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-36a57785-8e83-4716-9189-93bbdaf454b7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b7c57c1b-2a76-4e14-93e3-237868ffe8f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Lock "cinder-0e7c20dc-5e92-40cd-a0eb-e25902c8044f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:07:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b7c57c1b-2a76-4e14-93e3-237868ffe8f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Acquiring lock "cinder-quobyte-421ff259-511b-4737-bfc1-e991644ccd4d" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:07:44 devstack sudo[93290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-36a57785-8e83-4716-9189-93bbdaf454b7
Nov 05 15:07:44 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b7c57c1b-2a76-4e14-93e3-237868ffe8f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Lock "cinder-quobyte-421ff259-511b-4737-bfc1-e991644ccd4d" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:07:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b7c57c1b-2a76-4e14-93e3-237868ffe8f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Acquiring lock "cinder-quobyte-0e7c20dc-5e92-40cd-a0eb-e25902c8044f" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:07:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b7c57c1b-2a76-4e14-93e3-237868ffe8f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Lock "cinder-quobyte-0e7c20dc-5e92-40cd-a0eb-e25902c8044f" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:07:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b7c57c1b-2a76-4e14-93e3-237868ffe8f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Deleting offline snapshot 0e7c20dc-5e92-40cd-a0eb-e25902c8044f of volume 421ff259-511b-4737-bfc1-e991644ccd4d {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:07:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b7c57c1b-2a76-4e14-93e3-237868ffe8f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] snapshot_file for this snap is: volume-421ff259-511b-4737-bfc1-e991644ccd4d.0e7c20dc-5e92-40cd-a0eb-e25902c8044f {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:07:44 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[86820061-95fa-4ca0-bec2-95f1291b1dbf]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:07:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7c57c1b-2a76-4e14-93e3-237868ffe8f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.0e7c20dc-5e92-40cd-a0eb-e25902c8044f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:44 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-36a57785-8e83-4716-9189-93bbdaf454b7" returned: 0 in 0.540s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:07:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:07:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b882c89f-5c65-41d2-b6bd-80f7a1bf99f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36a57785-8e83-4716-9189-93bbdaf454b7', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6938cfcc-843e-4283-b8b5-b8362fd87de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:44 devstack sudo[93293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.0e7c20dc-5e92-40cd-a0eb-e25902c8044f
Nov 05 15:07:44 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:44 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Volume volume-36a57785-8e83-4716-9189-93bbdaf454b7 (36a57785-8e83-4716-9189-93bbdaf454b7): created successfully
Nov 05 15:07:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6938cfcc-843e-4283-b8b5-b8362fd87de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Flow 'volume_create_manager' (8b05350e-bbfb-4bcc-ad00-e671197666df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:07:44 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9f4f97fc-0d65-44ca-b1b5-13e6de0afb1c tempest-GroupsTest-1900800888 None] Created volume successfully.
Nov 05 15:07:45 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7c57c1b-2a76-4e14-93e3-237868ffe8f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.0e7c20dc-5e92-40cd-a0eb-e25902c8044f" returned: 0 in 0.969s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b7c57c1b-2a76-4e14-93e3-237868ffe8f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-421ff259-511b-4737-bfc1-e991644ccd4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:07:45 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b575b32d-9fc6-443e-8b45-9e2c4cad4db7]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:07:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7c57c1b-2a76-4e14-93e3-237868ffe8f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:45 devstack sudo[93299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d
Nov 05 15:07:45 devstack sudo[93299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:46 devstack sudo[93299]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7c57c1b-2a76-4e14-93e3-237868ffe8f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d" returned: 0 in 1.346s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7c57c1b-2a76-4e14-93e3-237868ffe8f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.0e7c20dc-5e92-40cd-a0eb-e25902c8044f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:46 devstack sudo[93305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.0e7c20dc-5e92-40cd-a0eb-e25902c8044f
Nov 05 15:07:46 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:46 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:07:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Flow 'volume_create_manager' (2f926540-495c-4cb7-8787-2bb1bb4bc46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:07:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eecedb6-1bb1-46af-9130-15605cf2619d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eecedb6-1bb1-46af-9130-15605cf2619d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-915459893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c19e1d53-93cd-4370-8fac-dca6aa571262,host='devstack@QuobyteHD#QuobyteHD',id=b69a566d-6fe0-4009-89b7-137e0a54ca6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e563db116934604a856c3bbdf5f541c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:46Z,use_quota=True,user_id='02a46074bffe40a48d7d121649e91f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65dbfbd6-cdd0-4917-bceb-5f795eb91dd1),volume_type_id=65dbfbd6-cdd0-4917-bceb-5f795eb91dd1)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad29deb-622e-431e-b9dc-de37f15a022e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad29deb-622e-431e-b9dc-de37f15a022e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc000e79-a4c3-4907-8b42-d747b28f0234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc000e79-a4c3-4907-8b42-d747b28f0234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b69a566d-6fe0-4009-89b7-137e0a54ca6b', 'volume_name': 'volume-b69a566d-6fe0-4009-89b7-137e0a54ca6b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be321c0-e309-4ab7-99a3-4abb630d81c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be321c0-e309-4ab7-99a3-4abb630d81c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b5f745-e6d9-42b5-aaaa-5a0932284004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:46 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Volume b69a566d-6fe0-4009-89b7-137e0a54ca6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b69a566d-6fe0-4009-89b7-137e0a54ca6b', 'volume_size': 1}
Nov 05 15:07:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:07:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:07:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c19e1d53-93cd-4370-8fac-dca6aa571262,created_at=2026-11-05T14:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-915459893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c19e1d53-93cd-4370-8fac-dca6aa571262,host='devstack@QuobyteHD#QuobyteHD',id=b69a566d-6fe0-4009-89b7-137e0a54ca6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e563db116934604a856c3bbdf5f541c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:46Z,use_quota=True,user_id='02a46074bffe40a48d7d121649e91f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65dbfbd6-cdd0-4917-bceb-5f795eb91dd1),volume_type_id=65dbfbd6-cdd0-4917-bceb-5f795eb91dd1)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:07:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Creating volume b69a566d-6fe0-4009-89b7-137e0a54ca6b {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:07:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:07:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:07:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:07:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:07:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:07:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:07:46 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:07:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b69a566d-6fe0-4009-89b7-137e0a54ca6b 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:47 devstack sudo[93307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b69a566d-6fe0-4009-89b7-137e0a54ca6b 1073741824
Nov 05 15:07:47 devstack sudo[93307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:47 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7c57c1b-2a76-4e14-93e3-237868ffe8f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.0e7c20dc-5e92-40cd-a0eb-e25902c8044f" returned: 0 in 0.875s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7c57c1b-2a76-4e14-93e3-237868ffe8f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.0e7c20dc-5e92-40cd-a0eb-e25902c8044f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:47 devstack sudo[93314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.0e7c20dc-5e92-40cd-a0eb-e25902c8044f
Nov 05 15:07:47 devstack sudo[93314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:47 devstack sudo[93314]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7c57c1b-2a76-4e14-93e3-237868ffe8f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d.0e7c20dc-5e92-40cd-a0eb-e25902c8044f" returned: 0 in 0.376s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b7c57c1b-2a76-4e14-93e3-237868ffe8f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Lock "cinder-quobyte-0e7c20dc-5e92-40cd-a0eb-e25902c8044f" released by "_delete_snapshot" :: held 3.922s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:07:48 devstack sudo[93307]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b69a566d-6fe0-4009-89b7-137e0a54ca6b 1073741824" returned: 0 in 1.028s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b7c57c1b-2a76-4e14-93e3-237868ffe8f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Lock "cinder-quobyte-421ff259-511b-4737-bfc1-e991644ccd4d" released by "delete_snapshot" :: held 3.998s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:07:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b69a566d-6fe0-4009-89b7-137e0a54ca6b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:48 devstack sudo[93321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b69a566d-6fe0-4009-89b7-137e0a54ca6b
Nov 05 15:07:48 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:48 devstack cinder-volume[87150]: WARNING cinder.quota [None req-b7c57c1b-2a76-4e14-93e3-237868ffe8f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:07:48 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b7c57c1b-2a76-4e14-93e3-237868ffe8f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Created reservations ['d7c3a97e-73d3-417d-ae60-cf9978a72204', '3395b8a6-b17e-47c6-a70c-0b4a797747b3', 'ed03de75-74a2-45ff-a472-aa1c77784427', '0be4d3a5-e1f6-4386-aa35-6451746600d8'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:07:48 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b7c57c1b-2a76-4e14-93e3-237868ffe8f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Delete snapshot completed successfully.
Nov 05 15:07:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b7c57c1b-2a76-4e14-93e3-237868ffe8f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Lock "cinder-0e7c20dc-5e92-40cd-a0eb-e25902c8044f-delete_snapshot" released by "delete_snapshot" :: held 4.410s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:07:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3c50c493-ef08-4949-90f8-f41013c0e6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Acquiring lock "cinder-421ff259-511b-4737-bfc1-e991644ccd4d-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:07:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3c50c493-ef08-4949-90f8-f41013c0e6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Lock "cinder-421ff259-511b-4737-bfc1-e991644ccd4d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:07:48 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b69a566d-6fe0-4009-89b7-137e0a54ca6b" returned: 0 in 0.682s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] <== create_volume: return (1804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:07:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:07:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3c50c493-ef08-4949-90f8-f41013c0e6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Acquiring lock "cinder-quobyte-421ff259-511b-4737-bfc1-e991644ccd4d" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:07:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b5f745-e6d9-42b5-aaaa-5a0932284004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b69a566d-6fe0-4009-89b7-137e0a54ca6b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d673a1c6-598a-4148-bffe-987a1847254b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:07:48 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Volume volume-b69a566d-6fe0-4009-89b7-137e0a54ca6b (b69a566d-6fe0-4009-89b7-137e0a54ca6b): created successfully
Nov 05 15:07:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d673a1c6-598a-4148-bffe-987a1847254b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:07:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Flow 'volume_create_manager' (2f926540-495c-4cb7-8787-2bb1bb4bc46f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:07:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3c50c493-ef08-4949-90f8-f41013c0e6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Lock "cinder-quobyte-421ff259-511b-4737-bfc1-e991644ccd4d" acquired by "delete_volume" :: waited 0.135s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:07:49 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-82a8766e-1337-4091-8bf5-769dc8748717 tempest-GroupsTest-1900800888 None] Created volume successfully.
Nov 05 15:07:49 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e665efbf-c7a9-452f-89eb-249f6e86a5ca]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:07:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c50c493-ef08-4949-90f8-f41013c0e6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:49 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-7793304b-8076-43a6-9556-6b07c3219f09 req-3b27d449-0863-46c9-a2f8-2bbb5cde99a8 tempest-ServerActionsTestOtherA-844328353 None] Terminate volume connection completed successfully.
Nov 05 15:07:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-7793304b-8076-43a6-9556-6b07c3219f09 req-3b27d449-0863-46c9-a2f8-2bbb5cde99a8 tempest-ServerActionsTestOtherA-844328353 None] Deleting attachment fdf1ccd7-bd5a-43ac-ac54-d94d09c7c8c8. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 15:07:49 devstack sudo[93369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d
Nov 05 15:07:49 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:49 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c50c493-ef08-4949-90f8-f41013c0e6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d" returned: 0 in 0.627s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c50c493-ef08-4949-90f8-f41013c0e6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:49 devstack sudo[93376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d
Nov 05 15:07:49 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:49 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-cdfe737a-c54f-48c4-9c6c-e0842ec2fb7d tempest-GroupsTest-1900800888 None] Update group completed successfully.
Nov 05 15:07:50 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c50c493-ef08-4949-90f8-f41013c0e6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-421ff259-511b-4737-bfc1-e991644ccd4d" returned: 0 in 0.438s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3c50c493-ef08-4949-90f8-f41013c0e6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Lock "cinder-quobyte-421ff259-511b-4737-bfc1-e991644ccd4d" released by "delete_volume" :: held 1.166s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:07:50 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-3c50c493-ef08-4949-90f8-f41013c0e6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Created reservations ['a828024c-ef8f-4185-abc9-121c0b96e716', '9edee229-1fa3-4d39-89ec-96762965e006', '15d11045-8a05-45c8-bd53-66a95c97d3ec', 'df3e8fe8-81b4-44a1-8170-c002c3b052d4'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:07:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3c50c493-ef08-4949-90f8-f41013c0e6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:07:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3c50c493-ef08-4949-90f8-f41013c0e6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:07:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3c50c493-ef08-4949-90f8-f41013c0e6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:07:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3c50c493-ef08-4949-90f8-f41013c0e6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:07:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3c50c493-ef08-4949-90f8-f41013c0e6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:07:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c50c493-ef08-4949-90f8-f41013c0e6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:50 devstack sudo[93380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:07:50 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:50 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c50c493-ef08-4949-90f8-f41013c0e6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.254s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:50 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-3c50c493-ef08-4949-90f8-f41013c0e6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:07:50 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3c50c493-ef08-4949-90f8-f41013c0e6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Deleted volume successfully.
Nov 05 15:07:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3c50c493-ef08-4949-90f8-f41013c0e6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-310637739 None] Lock "cinder-421ff259-511b-4737-bfc1-e991644ccd4d-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:07:51 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ae217e52-6ba2-4c72-a83c-c0749adaa77c tempest-GroupsTest-1900800888 None] Update group completed successfully.
Nov 05 15:07:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-7793304b-8076-43a6-9556-6b07c3219f09 req-d846fece-009e-4d90-b87d-fc51f9c8ee82 tempest-ServerActionsTestOtherA-844328353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:07:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-7793304b-8076-43a6-9556-6b07c3219f09 req-d846fece-009e-4d90-b87d-fc51f9c8ee82 tempest-ServerActionsTestOtherA-844328353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:07:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-7793304b-8076-43a6-9556-6b07c3219f09 req-d846fece-009e-4d90-b87d-fc51f9c8ee82 tempest-ServerActionsTestOtherA-844328353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:07:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-7793304b-8076-43a6-9556-6b07c3219f09 req-d846fece-009e-4d90-b87d-fc51f9c8ee82 tempest-ServerActionsTestOtherA-844328353 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628', 'name': 'volume-cff130e2-7a9a-4455-9f97-2a3937082353', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cdc904d2-f85a-4554-8e3c-dc86b7ce246c', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 15:07:51 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-7793304b-8076-43a6-9556-6b07c3219f09 req-d846fece-009e-4d90-b87d-fc51f9c8ee82 tempest-ServerActionsTestOtherA-844328353 None] attachment_update completed successfully.
Nov 05 15:07:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] Acquiring lock "cinder-quobyte-36a57785-8e83-4716-9189-93bbdaf454b7" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:07:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] Lock "cinder-quobyte-36a57785-8e83-4716-9189-93bbdaf454b7" acquired by "delete_volume" :: waited 0.043s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:07:53 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d526cc21-4d9b-467d-b447-e8ca3c1cc1c7]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:07:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-36a57785-8e83-4716-9189-93bbdaf454b7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:54 devstack sudo[93845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-36a57785-8e83-4716-9189-93bbdaf454b7
Nov 05 15:07:54 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:54 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-36a57785-8e83-4716-9189-93bbdaf454b7" returned: 0 in 0.587s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-36a57785-8e83-4716-9189-93bbdaf454b7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:54 devstack sudo[93851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-36a57785-8e83-4716-9189-93bbdaf454b7
Nov 05 15:07:54 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:54 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-36a57785-8e83-4716-9189-93bbdaf454b7" returned: 0 in 0.513s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] Lock "cinder-quobyte-36a57785-8e83-4716-9189-93bbdaf454b7" released by "delete_volume" :: held 1.254s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:07:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] Acquiring lock "cinder-quobyte-b69a566d-6fe0-4009-89b7-137e0a54ca6b" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:07:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] Lock "cinder-quobyte-b69a566d-6fe0-4009-89b7-137e0a54ca6b" acquired by "delete_volume" :: waited 0.042s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:07:55 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[29db5b39-5269-4722-a822-47d899226e60]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:07:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b69a566d-6fe0-4009-89b7-137e0a54ca6b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:55 devstack sudo[93856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b69a566d-6fe0-4009-89b7-137e0a54ca6b
Nov 05 15:07:55 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:55 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b69a566d-6fe0-4009-89b7-137e0a54ca6b" returned: 0 in 0.696s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b69a566d-6fe0-4009-89b7-137e0a54ca6b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:55 devstack sudo[93889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b69a566d-6fe0-4009-89b7-137e0a54ca6b
Nov 05 15:07:55 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:56 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b69a566d-6fe0-4009-89b7-137e0a54ca6b" returned: 0 in 0.457s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] Lock "cinder-quobyte-b69a566d-6fe0-4009-89b7-137e0a54ca6b" released by "delete_volume" :: held 1.303s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:07:56 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] Created reservations ['707657f4-5294-4772-89c7-0b7d6265baea'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:07:56 devstack cinder-volume[87150]: WARNING cinder.quota [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1720278825 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1720278825, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:07:56 devstack cinder-volume[87150]: WARNING cinder.quota [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1720278825 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1720278825, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:07:56 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] Created reservations ['c8365843-a35a-4df4-8dc3-244a8fdd86c1', 'c48318dd-7338-49c2-94d2-75ace728d8dd', 'c1307add-6712-44df-94c8-b5793ca367a2', '0578b3cc-bb7d-4d6f-aa5d-6c0e62568bfb'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:07:56 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] Created reservations ['3fd49744-2c80-4653-aec1-0a8012fab166', '0d693de6-21f1-4e68-9362-01070c61d448', '243250c2-1644-46b4-9fc6-ff9acfd81fac', '07a7781b-3a8e-466a-8372-9841e1f0e480'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:07:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:07:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:07:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:07:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:07:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:07:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:07:57 devstack sudo[93892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:07:57 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:07:57 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root
Nov 05 15:07:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.424s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:07:57 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:07:57 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-59b53c21-86e6-4459-836a-0aaaa3f0b27f tempest-GroupsTest-1900800888 None] Delete group completed successfully.
Nov 05 15:08:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b447ae73-8db2-4916-89bf-f434c8d8fbb5 tempest-GroupsV314Test-1776725349 None] Group tempest-GroupsV314Test-Group-834580475: creating
Nov 05 15:08:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b447ae73-8db2-4916-89bf-f434c8d8fbb5 tempest-GroupsV314Test-1776725349 None] Group tempest-GroupsV314Test-Group-834580475: created successfully
Nov 05 15:08:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b447ae73-8db2-4916-89bf-f434c8d8fbb5 tempest-GroupsV314Test-1776725349 None] Create group completed successfully.
Nov 05 15:08:07 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:08:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Flow 'volume_create_manager' (92994fd6-4a6b-4b81-9ea9-035db27f1d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:08:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9257d5f6-0309-4980-8142-df0315696546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9257d5f6-0309-4980-8142-df0315696546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-286040790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa17a56-1d11-478c-869c-6fb380dfe694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbac5bd198a542d7b67c1150f89a8674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:07Z,use_quota=True,user_id='a9a20ed2c3494d3e8d67ce6462d5d90c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (095601ca-cbc1-4bfb-9093-c6d2831f5648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (095601ca-cbc1-4bfb-9093-c6d2831f5648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057ddceb-2863-4a27-b185-d777ad731a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057ddceb-2863-4a27-b185-d777ad731a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aa17a56-1d11-478c-869c-6fb380dfe694', 'volume_name': 'volume-9aa17a56-1d11-478c-869c-6fb380dfe694', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff0f425-0b78-430b-a730-7b36c894f41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff0f425-0b78-430b-a730-7b36c894f41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da215db5-9666-45c4-b6ca-8d9fc2aa1844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:07 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Volume 9aa17a56-1d11-478c-869c-6fb380dfe694: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aa17a56-1d11-478c-869c-6fb380dfe694', 'volume_size': 1}
Nov 05 15:08:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-286040790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa17a56-1d11-478c-869c-6fb380dfe694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbac5bd198a542d7b67c1150f89a8674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:07Z,use_quota=True,user_id='a9a20ed2c3494d3e8d67ce6462d5d90c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:08:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Creating volume 9aa17a56-1d11-478c-869c-6fb380dfe694 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:08:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:08:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:08:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:08:07 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:08:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9aa17a56-1d11-478c-869c-6fb380dfe694 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:07 devstack sudo[93901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9aa17a56-1d11-478c-869c-6fb380dfe694 1073741824
Nov 05 15:08:07 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:08 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9aa17a56-1d11-478c-869c-6fb380dfe694 1073741824" returned: 0 in 0.486s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9aa17a56-1d11-478c-869c-6fb380dfe694 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:08 devstack sudo[93907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9aa17a56-1d11-478c-869c-6fb380dfe694
Nov 05 15:08:08 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:08 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9aa17a56-1d11-478c-869c-6fb380dfe694" returned: 0 in 0.453s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da215db5-9666-45c4-b6ca-8d9fc2aa1844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aa17a56-1d11-478c-869c-6fb380dfe694', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced42cda-1555-49f9-9d07-60adf8ac2661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:08 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Volume volume-9aa17a56-1d11-478c-869c-6fb380dfe694 (9aa17a56-1d11-478c-869c-6fb380dfe694): created successfully
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced42cda-1555-49f9-9d07-60adf8ac2661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Flow 'volume_create_manager' (92994fd6-4a6b-4b81-9ea9-035db27f1d64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Flow 'volume_create_manager' (1c382c44-8ffd-425f-8335-553ddc026f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77b23f9-f338-4c9b-a435-3ac3adbd4ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:08 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d5241572-2803-4b33-a32b-3988bd236eed tempest-AttachVolumeNegativeTest-1140258724 None] Created volume successfully.
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77b23f9-f338-4c9b-a435-3ac3adbd4ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-289334049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=918dcdf2-f3f7-46cb-882f-05d3fbdb5aaa,host='devstack@QuobyteHD#QuobyteHD',id=772580b9-af6d-490c-bcaa-7c54484e9953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53967ea4fd774fc7b03cfeb0ca18d96b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:09Z,use_quota=True,user_id='9e8559a691884f1ebf64111fbbfabbb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49d0b6ff-21fe-4ce9-92a1-ed2dab28028e),volume_type_id=49d0b6ff-21fe-4ce9-92a1-ed2dab28028e)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f824f410-91f3-4bae-871f-0d882f171ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f824f410-91f3-4bae-871f-0d882f171ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ab708bd-130e-414a-8771-55dc5b5e2cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ab708bd-130e-414a-8771-55dc5b5e2cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '772580b9-af6d-490c-bcaa-7c54484e9953', 'volume_name': 'volume-772580b9-af6d-490c-bcaa-7c54484e9953', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fa84bc-1c9d-4d15-81d7-06e346e0263d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fa84bc-1c9d-4d15-81d7-06e346e0263d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f2707bc-f869-41a9-9502-45a32c792831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:08 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Volume 772580b9-af6d-490c-bcaa-7c54484e9953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-772580b9-af6d-490c-bcaa-7c54484e9953', 'volume_size': 1}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=918dcdf2-f3f7-46cb-882f-05d3fbdb5aaa,created_at=2026-11-05T14:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-289334049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=918dcdf2-f3f7-46cb-882f-05d3fbdb5aaa,host='devstack@QuobyteHD#QuobyteHD',id=772580b9-af6d-490c-bcaa-7c54484e9953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53967ea4fd774fc7b03cfeb0ca18d96b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:09Z,use_quota=True,user_id='9e8559a691884f1ebf64111fbbfabbb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49d0b6ff-21fe-4ce9-92a1-ed2dab28028e),volume_type_id=49d0b6ff-21fe-4ce9-92a1-ed2dab28028e)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Creating volume 772580b9-af6d-490c-bcaa-7c54484e9953 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:08:08 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:08:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:08 devstack sudo[93911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953 1073741824
Nov 05 15:08:08 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:09 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953 1073741824" returned: 0 in 0.482s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:09 devstack sudo[93917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953
Nov 05 15:08:09 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:09 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953" returned: 0 in 0.323s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:08:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f2707bc-f869-41a9-9502-45a32c792831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-772580b9-af6d-490c-bcaa-7c54484e9953', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d55b262-9222-43b8-b4d3-77760df08007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:09 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Volume volume-772580b9-af6d-490c-bcaa-7c54484e9953 (772580b9-af6d-490c-bcaa-7c54484e9953): created successfully
Nov 05 15:08:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d55b262-9222-43b8-b4d3-77760df08007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Flow 'volume_create_manager' (1c382c44-8ffd-425f-8335-553ddc026f23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:08:09 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6a677bd0-a5cc-4dfe-815a-be99b77307e2 tempest-GroupsV314Test-1776725349 None] Created volume successfully.
Nov 05 15:08:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-8026881f-71be-4e90-9fd7-9586fc34c970 req-a2deeed0-416e-4a13-8bcb-62cbca6ac929 tempest-AttachVolumeNegativeTest-1140258724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-8026881f-71be-4e90-9fd7-9586fc34c970 req-a2deeed0-416e-4a13-8bcb-62cbca6ac929 tempest-AttachVolumeNegativeTest-1140258724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-8026881f-71be-4e90-9fd7-9586fc34c970 req-a2deeed0-416e-4a13-8bcb-62cbca6ac929 tempest-AttachVolumeNegativeTest-1140258724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:10 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Cloning volume 772580b9-af6d-490c-bcaa-7c54484e9953 to volume a9fec6bc-6159-4e08-80c9-0a60ce168311
Nov 05 15:08:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-8026881f-71be-4e90-9fd7-9586fc34c970 req-a2deeed0-416e-4a13-8bcb-62cbca6ac929 tempest-AttachVolumeNegativeTest-1140258724 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628', 'name': 'volume-9aa17a56-1d11-478c-869c-6fb380dfe694', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8503f8eb-6ded-4186-82a0-4d21ccf43f2d', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 15:08:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Creating offline snapshot 545dac41-e6cb-456f-9707-b887b9687546 of volume 772580b9-af6d-490c-bcaa-7c54484e9953 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:08:10 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c643e06-2d87-4def-84e5-f390b45cd348]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:08:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:10 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-8026881f-71be-4e90-9fd7-9586fc34c970 req-a2deeed0-416e-4a13-8bcb-62cbca6ac929 tempest-AttachVolumeNegativeTest-1140258724 None] attachment_update completed successfully.
Nov 05 15:08:11 devstack sudo[93934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953
Nov 05 15:08:11 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:11 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953" returned: 0 in 0.734s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.545dac41-e6cb-456f-9707-b887b9687546 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:11 devstack sudo[93945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.545dac41-e6cb-456f-9707-b887b9687546 1G
Nov 05 15:08:11 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:12 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.545dac41-e6cb-456f-9707-b887b9687546 1G" returned: 0 in 0.553s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-772580b9-af6d-490c-bcaa-7c54484e9953 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.545dac41-e6cb-456f-9707-b887b9687546 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:12 devstack sudo[93975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-772580b9-af6d-490c-bcaa-7c54484e9953 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.545dac41-e6cb-456f-9707-b887b9687546
Nov 05 15:08:12 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:12 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-772580b9-af6d-490c-bcaa-7c54484e9953 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.545dac41-e6cb-456f-9707-b887b9687546" returned: 0 in 0.350s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:12 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.545dac41-e6cb-456f-9707-b887b9687546 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 15:08:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.545dac41-e6cb-456f-9707-b887b9687546 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:12 devstack sudo[93990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.545dac41-e6cb-456f-9707-b887b9687546
Nov 05 15:08:12 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:13 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.545dac41-e6cb-456f-9707-b887b9687546" returned: 0 in 0.427s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:13 devstack sudo[93993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.info
Nov 05 15:08:13 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:13 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.info" returned: 0 in 0.314s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:13 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 15:08:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:13 devstack sudo[93997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.info
Nov 05 15:08:13 devstack sudo[93997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:13 devstack sudo[93997]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.info" returned: 0 in 0.317s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Acquiring lock "cinder-quobyte-a9fec6bc-6159-4e08-80c9-0a60ce168311" by "_copy_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:08:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Lock "cinder-quobyte-a9fec6bc-6159-4e08-80c9-0a60ce168311" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:08:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] snapshot: 545dac41-e6cb-456f-9707-b887b9687546, volume: a9fec6bc-6159-4e08-80c9-0a60ce168311,  {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 15:08:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:08:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:08:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:13 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-088286a6-4eea-4351-a3a6-169aa0f52ede req-885e5a7c-8f9c-498e-a135-5f9d0205e448 tempest-AttachVolumeNegativeTest-1140258724 None] Terminate volume connection completed successfully.
Nov 05 15:08:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-088286a6-4eea-4351-a3a6-169aa0f52ede req-885e5a7c-8f9c-498e-a135-5f9d0205e448 tempest-AttachVolumeNegativeTest-1140258724 None] Deleting attachment 8503f8eb-6ded-4186-82a0-4d21ccf43f2d. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 15:08:13 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[77096b59-a38d-40d5-b552-94fc5e729edf]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:08:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.545dac41-e6cb-456f-9707-b887b9687546 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:13 devstack sudo[94002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.545dac41-e6cb-456f-9707-b887b9687546
Nov 05 15:08:13 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:14 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.545dac41-e6cb-456f-9707-b887b9687546" returned: 0 in 0.475s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-772580b9-af6d-490c-bcaa-7c54484e9953(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:08:14 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64ec2a6-d07b-45f8-8927-48904d5859e4]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:08:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:14 devstack sudo[94041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953
Nov 05 15:08:14 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:14 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953" returned: 0 in 0.427s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953 {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 15:08:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Creating direct copy from snapshot {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 15:08:14 devstack cinder-volume[87150]: DEBUG cinder.utils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Path /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a9fec6bc-6159-4e08-80c9-0a60ce168311 not found in is_blk_device check {{(pid=87150) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 15:08:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a9fec6bc-6159-4e08-80c9-0a60ce168311 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:14 devstack sudo[94049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a9fec6bc-6159-4e08-80c9-0a60ce168311
Nov 05 15:08:14 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:20 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:08:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Flow 'volume_create_manager' (f658752c-5da8-40fd-be8a-e4a005b2e33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:08:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20c359f-51e3-493c-8c8c-9c2d378fe960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20c359f-51e3-493c-8c8c-9c2d378fe960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1374839496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ad7f6a5-f733-4594-8116-4f659813aa0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7f2116ba624dda96376e9881b32eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:21Z,use_quota=True,user_id='67aea7e81e714b99a06ea42cb1def4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c2787b-3f69-4fc7-89d1-b7e079ef7127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c2787b-3f69-4fc7-89d1-b7e079ef7127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (020b7914-7180-498a-9625-3159bfaf8cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (020b7914-7180-498a-9625-3159bfaf8cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ad7f6a5-f733-4594-8116-4f659813aa0a', 'volume_name': 'volume-5ad7f6a5-f733-4594-8116-4f659813aa0a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4abc297f-3916-4831-aa5f-82931d5916ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4abc297f-3916-4831-aa5f-82931d5916ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56be70bc-41aa-4955-92f7-65334ed2ef13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:21 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Volume 5ad7f6a5-f733-4594-8116-4f659813aa0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ad7f6a5-f733-4594-8116-4f659813aa0a', 'volume_size': 1}
Nov 05 15:08:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:24 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a9fec6bc-6159-4e08-80c9-0a60ce168311" returned: 0 in 9.459s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:24 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Image conversion details: src /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953, size 1024.00 MB, duration 9.46 sec, destination /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a9fec6bc-6159-4e08-80c9-0a60ce168311 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:08:24 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Converted 1024.00 MB image at 108.25 MB/s
Nov 05 15:08:24 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a9fec6bc-6159-4e08-80c9-0a60ce168311 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 15:08:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a9fec6bc-6159-4e08-80c9-0a60ce168311 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:24 devstack sudo[94107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a9fec6bc-6159-4e08-80c9-0a60ce168311
Nov 05 15:08:24 devstack sudo[94107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:24 devstack sudo[94107]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a9fec6bc-6159-4e08-80c9-0a60ce168311" returned: 0 in 0.318s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Lock "cinder-quobyte-a9fec6bc-6159-4e08-80c9-0a60ce168311" released by "_copy_volume_from_snapshot" :: held 10.775s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:08:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Acquiring lock "cinder-quobyte-545dac41-e6cb-456f-9707-b887b9687546" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:08:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Lock "cinder-quobyte-545dac41-e6cb-456f-9707-b887b9687546" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:08:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Deleting offline snapshot 545dac41-e6cb-456f-9707-b887b9687546 of volume 772580b9-af6d-490c-bcaa-7c54484e9953 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:08:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] snapshot_file for this snap is: volume-772580b9-af6d-490c-bcaa-7c54484e9953.545dac41-e6cb-456f-9707-b887b9687546 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:08:24 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6851f4f3-2684-487d-a64b-32424d08aeee]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:08:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.545dac41-e6cb-456f-9707-b887b9687546 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:24 devstack sudo[94126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.545dac41-e6cb-456f-9707-b887b9687546
Nov 05 15:08:24 devstack sudo[94126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:25 devstack sudo[94126]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.545dac41-e6cb-456f-9707-b887b9687546" returned: 0 in 0.586s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-772580b9-af6d-490c-bcaa-7c54484e9953(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:08:25 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[275a2698-d4e6-4d1f-8319-824f0c8318ea]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:08:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:25 devstack sudo[94139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953
Nov 05 15:08:25 devstack sudo[94139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:25 devstack sudo[94139]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953" returned: 0 in 0.626s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.545dac41-e6cb-456f-9707-b887b9687546 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:25 devstack sudo[94146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.545dac41-e6cb-456f-9707-b887b9687546
Nov 05 15:08:25 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:26 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.545dac41-e6cb-456f-9707-b887b9687546" returned: 0 in 0.477s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.545dac41-e6cb-456f-9707-b887b9687546 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:26 devstack sudo[94156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.545dac41-e6cb-456f-9707-b887b9687546
Nov 05 15:08:26 devstack sudo[94156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-fe547568-f08b-4da7-87c5-58dbe25a0cf0 req-bb95d3c0-f0d3-4d47-a8dc-de2958ff43c9 tempest-ServerActionsTestOtherA-844328353 None] Terminate volume connection completed successfully.
Nov 05 15:08:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-fe547568-f08b-4da7-87c5-58dbe25a0cf0 req-bb95d3c0-f0d3-4d47-a8dc-de2958ff43c9 tempest-ServerActionsTestOtherA-844328353 None] Deleting attachment cdc904d2-f85a-4554-8e3c-dc86b7ce246c. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 15:08:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-fe547568-f08b-4da7-87c5-58dbe25a0cf0 req-ac95bff4-137a-4271-b08e-518390adcc19 tempest-ServerActionsTestOtherA-844328353 None] Acquiring lock "cinder-cff130e2-7a9a-4455-9f97-2a3937082353-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:08:26 devstack sudo[94156]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953.545dac41-e6cb-456f-9707-b887b9687546" returned: 0 in 0.385s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-fe547568-f08b-4da7-87c5-58dbe25a0cf0 req-ac95bff4-137a-4271-b08e-518390adcc19 tempest-ServerActionsTestOtherA-844328353 None] Lock "cinder-cff130e2-7a9a-4455-9f97-2a3937082353-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:08:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Lock "cinder-quobyte-545dac41-e6cb-456f-9707-b887b9687546" released by "_delete_snapshot" :: held 2.279s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:08:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.108s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.807s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1374839496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ad7f6a5-f733-4594-8116-4f659813aa0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7f2116ba624dda96376e9881b32eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:21Z,use_quota=True,user_id='67aea7e81e714b99a06ea42cb1def4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:08:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Creating volume 5ad7f6a5-f733-4594-8116-4f659813aa0a {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:08:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:08:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:08:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:08:26 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:08:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5ad7f6a5-f733-4594-8116-4f659813aa0a 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-fe547568-f08b-4da7-87c5-58dbe25a0cf0 req-ac95bff4-137a-4271-b08e-518390adcc19 tempest-ServerActionsTestOtherA-844328353 None] Acquiring lock "cinder-quobyte-cff130e2-7a9a-4455-9f97-2a3937082353" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:08:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-fe547568-f08b-4da7-87c5-58dbe25a0cf0 req-ac95bff4-137a-4271-b08e-518390adcc19 tempest-ServerActionsTestOtherA-844328353 None] Lock "cinder-quobyte-cff130e2-7a9a-4455-9f97-2a3937082353" acquired by "delete_volume" :: waited 0.036s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:08:27 devstack sudo[94171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5ad7f6a5-f733-4594-8116-4f659813aa0a 1073741824
Nov 05 15:08:27 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:27 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea36b1b-31e7-4290-9ae9-c937770a4813]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:08:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-fe547568-f08b-4da7-87c5-58dbe25a0cf0 req-ac95bff4-137a-4271-b08e-518390adcc19 tempest-ServerActionsTestOtherA-844328353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cff130e2-7a9a-4455-9f97-2a3937082353 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:27 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e4cd7d82-1425-4817-9d55-a1c29029d735 tempest-GroupsV314Test-1776725349 None] Create group from source-group-918dcdf2-f3f7-46cb-882f-05d3fbdb5aaa completed successfully.
Nov 05 15:08:27 devstack sudo[94173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cff130e2-7a9a-4455-9f97-2a3937082353
Nov 05 15:08:27 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:27 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-fe547568-f08b-4da7-87c5-58dbe25a0cf0 req-ac95bff4-137a-4271-b08e-518390adcc19 tempest-ServerActionsTestOtherA-844328353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cff130e2-7a9a-4455-9f97-2a3937082353" returned: 0 in 0.543s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-fe547568-f08b-4da7-87c5-58dbe25a0cf0 req-ac95bff4-137a-4271-b08e-518390adcc19 tempest-ServerActionsTestOtherA-844328353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cff130e2-7a9a-4455-9f97-2a3937082353 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:27 devstack sudo[94183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cff130e2-7a9a-4455-9f97-2a3937082353
Nov 05 15:08:27 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:27 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5ad7f6a5-f733-4594-8116-4f659813aa0a 1073741824" returned: 0 in 0.804s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5ad7f6a5-f733-4594-8116-4f659813aa0a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:27 devstack sudo[94185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5ad7f6a5-f733-4594-8116-4f659813aa0a
Nov 05 15:08:27 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:27 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-fe547568-f08b-4da7-87c5-58dbe25a0cf0 req-ac95bff4-137a-4271-b08e-518390adcc19 tempest-ServerActionsTestOtherA-844328353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cff130e2-7a9a-4455-9f97-2a3937082353" returned: 0 in 0.384s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-fe547568-f08b-4da7-87c5-58dbe25a0cf0 req-ac95bff4-137a-4271-b08e-518390adcc19 tempest-ServerActionsTestOtherA-844328353 None] Lock "cinder-quobyte-cff130e2-7a9a-4455-9f97-2a3937082353" released by "delete_volume" :: held 0.997s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG cinder.quota [req-fe547568-f08b-4da7-87c5-58dbe25a0cf0 req-ac95bff4-137a-4271-b08e-518390adcc19 tempest-ServerActionsTestOtherA-844328353 None] Created reservations ['0720e4f2-e42b-42ea-8694-edfb770fe886', '3c02090b-173d-45ce-ae78-e653e48b2c5f', 'b79a6220-1a43-45ee-889f-b8d184217e22', '97c51108-6fe2-463a-8109-26f7345f2285'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6a75f64c-9965-40f4-9554-1d52dd72d00b tempest-GroupsV314Test-1776725349 None] Acquiring lock "cinder-quobyte-a9fec6bc-6159-4e08-80c9-0a60ce168311" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:08:28 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5ad7f6a5-f733-4594-8116-4f659813aa0a" returned: 0 in 0.368s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6a75f64c-9965-40f4-9554-1d52dd72d00b tempest-GroupsV314Test-1776725349 None] Lock "cinder-quobyte-a9fec6bc-6159-4e08-80c9-0a60ce168311" acquired by "delete_volume" :: waited 0.040s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56be70bc-41aa-4955-92f7-65334ed2ef13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ad7f6a5-f733-4594-8116-4f659813aa0a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4caccdf-b0f4-4fec-bdda-5955c6e8be9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d72ebb6-0f18-405a-9a56-8ac3dd0b6607]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a75f64c-9965-40f4-9554-1d52dd72d00b tempest-GroupsV314Test-1776725349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a9fec6bc-6159-4e08-80c9-0a60ce168311 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:28 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Volume volume-5ad7f6a5-f733-4594-8116-4f659813aa0a (5ad7f6a5-f733-4594-8116-4f659813aa0a): created successfully
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4caccdf-b0f4-4fec-bdda-5955c6e8be9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Flow 'volume_create_manager' (f658752c-5da8-40fd-be8a-e4a005b2e33b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-fe547568-f08b-4da7-87c5-58dbe25a0cf0 req-ac95bff4-137a-4271-b08e-518390adcc19 tempest-ServerActionsTestOtherA-844328353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-fe547568-f08b-4da7-87c5-58dbe25a0cf0 req-ac95bff4-137a-4271-b08e-518390adcc19 tempest-ServerActionsTestOtherA-844328353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-fe547568-f08b-4da7-87c5-58dbe25a0cf0 req-ac95bff4-137a-4271-b08e-518390adcc19 tempest-ServerActionsTestOtherA-844328353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-fe547568-f08b-4da7-87c5-58dbe25a0cf0 req-ac95bff4-137a-4271-b08e-518390adcc19 tempest-ServerActionsTestOtherA-844328353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-fe547568-f08b-4da7-87c5-58dbe25a0cf0 req-ac95bff4-137a-4271-b08e-518390adcc19 tempest-ServerActionsTestOtherA-844328353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-fe547568-f08b-4da7-87c5-58dbe25a0cf0 req-ac95bff4-137a-4271-b08e-518390adcc19 tempest-ServerActionsTestOtherA-844328353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3d6e88b8-a70e-4d86-b71f-6704730d6198 tempest-ServerActionsTestOtherA-844328353 None] Acquiring lock "cinder-91989d49-c84f-4898-b4e6-706228ac19c0-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:08:28 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-938609e5-44eb-43f4-a0f9-ea7ca0d95c80 tempest-VolumesListAdminTestJSON-159991351 None] Created volume successfully.
Nov 05 15:08:28 devstack sudo[94190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:08:28 devstack sudo[94190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:28 devstack sudo[94189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a9fec6bc-6159-4e08-80c9-0a60ce168311
Nov 05 15:08:28 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3d6e88b8-a70e-4d86-b71f-6704730d6198 tempest-ServerActionsTestOtherA-844328353 None] Lock "cinder-91989d49-c84f-4898-b4e6-706228ac19c0-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3d6e88b8-a70e-4d86-b71f-6704730d6198 tempest-ServerActionsTestOtherA-844328353 None] Acquiring lock "cinder-quobyte-91989d49-c84f-4898-b4e6-706228ac19c0" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3d6e88b8-a70e-4d86-b71f-6704730d6198 tempest-ServerActionsTestOtherA-844328353 None] Lock "cinder-quobyte-91989d49-c84f-4898-b4e6-706228ac19c0" acquired by "delete_volume" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab88767-3578-44c1-b19b-2c559bc261d0]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3d6e88b8-a70e-4d86-b71f-6704730d6198 tempest-ServerActionsTestOtherA-844328353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-91989d49-c84f-4898-b4e6-706228ac19c0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:28 devstack sudo[94194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-91989d49-c84f-4898-b4e6-706228ac19c0
Nov 05 15:08:28 devstack sudo[94194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:28 devstack sudo[94190]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-fe547568-f08b-4da7-87c5-58dbe25a0cf0 req-ac95bff4-137a-4271-b08e-518390adcc19 tempest-ServerActionsTestOtherA-844328353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.499s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG cinder.manager [req-fe547568-f08b-4da7-87c5-58dbe25a0cf0 req-ac95bff4-137a-4271-b08e-518390adcc19 tempest-ServerActionsTestOtherA-844328353 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:08:28 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-fe547568-f08b-4da7-87c5-58dbe25a0cf0 req-ac95bff4-137a-4271-b08e-518390adcc19 tempest-ServerActionsTestOtherA-844328353 None] Deleted volume successfully.
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-fe547568-f08b-4da7-87c5-58dbe25a0cf0 req-ac95bff4-137a-4271-b08e-518390adcc19 tempest-ServerActionsTestOtherA-844328353 None] Lock "cinder-cff130e2-7a9a-4455-9f97-2a3937082353-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:08:28 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a75f64c-9965-40f4-9554-1d52dd72d00b tempest-GroupsV314Test-1776725349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a9fec6bc-6159-4e08-80c9-0a60ce168311" returned: 0 in 0.651s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a75f64c-9965-40f4-9554-1d52dd72d00b tempest-GroupsV314Test-1776725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a9fec6bc-6159-4e08-80c9-0a60ce168311 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:29 devstack sudo[94200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a9fec6bc-6159-4e08-80c9-0a60ce168311
Nov 05 15:08:29 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:29 devstack sudo[94194]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3d6e88b8-a70e-4d86-b71f-6704730d6198 tempest-ServerActionsTestOtherA-844328353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-91989d49-c84f-4898-b4e6-706228ac19c0" returned: 0 in 0.733s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3d6e88b8-a70e-4d86-b71f-6704730d6198 tempest-ServerActionsTestOtherA-844328353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-91989d49-c84f-4898-b4e6-706228ac19c0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:29 devstack sudo[94211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-91989d49-c84f-4898-b4e6-706228ac19c0
Nov 05 15:08:29 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:29 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a75f64c-9965-40f4-9554-1d52dd72d00b tempest-GroupsV314Test-1776725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a9fec6bc-6159-4e08-80c9-0a60ce168311" returned: 0 in 0.481s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6a75f64c-9965-40f4-9554-1d52dd72d00b tempest-GroupsV314Test-1776725349 None] Lock "cinder-quobyte-a9fec6bc-6159-4e08-80c9-0a60ce168311" released by "delete_volume" :: held 1.247s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Flow 'volume_create_manager' (e7f7fa57-5c59-48a6-ae04-ac3e03344b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4bba936-491b-4299-b58a-f2036f73d4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4bba936-491b-4299-b58a-f2036f73d4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-123940540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67aa6643-a4dc-4fc5-b674-c9cf052c271c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7f2116ba624dda96376e9881b32eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:29Z,use_quota=True,user_id='67aea7e81e714b99a06ea42cb1def4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f10a06-6b7a-41c6-8773-a063a64e91b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f10a06-6b7a-41c6-8773-a063a64e91b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7d0b83-6e35-4cd4-83d1-7e70c67ec959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7d0b83-6e35-4cd4-83d1-7e70c67ec959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67aa6643-a4dc-4fc5-b674-c9cf052c271c', 'volume_name': 'volume-67aa6643-a4dc-4fc5-b674-c9cf052c271c', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a39fc4fd-07f9-4447-8a09-d1f0ea21c529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a39fc4fd-07f9-4447-8a09-d1f0ea21c529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a70a426-af32-47f6-a18b-70b6dd96223c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:29 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Volume 67aa6643-a4dc-4fc5-b674-c9cf052c271c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67aa6643-a4dc-4fc5-b674-c9cf052c271c', 'volume_size': 1}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-123940540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67aa6643-a4dc-4fc5-b674-c9cf052c271c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7f2116ba624dda96376e9881b32eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:29Z,use_quota=True,user_id='67aea7e81e714b99a06ea42cb1def4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Creating volume 67aa6643-a4dc-4fc5-b674-c9cf052c271c {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:08:29 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-67aa6643-a4dc-4fc5-b674-c9cf052c271c 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:29 devstack sudo[94219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-67aa6643-a4dc-4fc5-b674-c9cf052c271c 1073741824
Nov 05 15:08:29 devstack sudo[94219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-6a75f64c-9965-40f4-9554-1d52dd72d00b tempest-GroupsV314Test-1776725349 None] Created reservations ['f2c64c4c-73f9-41d3-96a8-fc85ee67a6af'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:08:29 devstack cinder-volume[87150]: WARNING cinder.quota [None req-6a75f64c-9965-40f4-9554-1d52dd72d00b tempest-GroupsV314Test-1776725349 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1186631975 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1186631975, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:08:29 devstack cinder-volume[87150]: WARNING cinder.quota [None req-6a75f64c-9965-40f4-9554-1d52dd72d00b tempest-GroupsV314Test-1776725349 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1186631975 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1186631975, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:08:29 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3d6e88b8-a70e-4d86-b71f-6704730d6198 tempest-ServerActionsTestOtherA-844328353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-91989d49-c84f-4898-b4e6-706228ac19c0" returned: 0 in 0.435s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3d6e88b8-a70e-4d86-b71f-6704730d6198 tempest-ServerActionsTestOtherA-844328353 None] Lock "cinder-quobyte-91989d49-c84f-4898-b4e6-706228ac19c0" released by "delete_volume" :: held 1.250s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-6a75f64c-9965-40f4-9554-1d52dd72d00b tempest-GroupsV314Test-1776725349 None] Created reservations ['d5a53e72-526d-489f-ba45-3d70862a2a77', '2b6d236b-7194-4ad3-ac86-b81ab366e8ed', 'd943314f-dda9-4131-8937-0af0a6434340', '8ca398a2-5ae6-4a24-a6dd-996df57e6a62'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:08:29 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-3d6e88b8-a70e-4d86-b71f-6704730d6198 tempest-ServerActionsTestOtherA-844328353 None] Created reservations ['70207561-6982-43f4-9096-0b7c8d11aa32', '7745cc84-6542-4048-beed-09f785cc519c', '4d6c3631-3827-427b-abae-c80aac0a3ded', '76c8ef0c-0b1b-41c7-94f3-e19c6900eb57'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:08:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3d6e88b8-a70e-4d86-b71f-6704730d6198 tempest-ServerActionsTestOtherA-844328353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3d6e88b8-a70e-4d86-b71f-6704730d6198 tempest-ServerActionsTestOtherA-844328353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3d6e88b8-a70e-4d86-b71f-6704730d6198 tempest-ServerActionsTestOtherA-844328353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:08:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3d6e88b8-a70e-4d86-b71f-6704730d6198 tempest-ServerActionsTestOtherA-844328353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:08:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3d6e88b8-a70e-4d86-b71f-6704730d6198 tempest-ServerActionsTestOtherA-844328353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3d6e88b8-a70e-4d86-b71f-6704730d6198 tempest-ServerActionsTestOtherA-844328353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6a75f64c-9965-40f4-9554-1d52dd72d00b tempest-GroupsV314Test-1776725349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6a75f64c-9965-40f4-9554-1d52dd72d00b tempest-GroupsV314Test-1776725349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6a75f64c-9965-40f4-9554-1d52dd72d00b tempest-GroupsV314Test-1776725349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:08:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6a75f64c-9965-40f4-9554-1d52dd72d00b tempest-GroupsV314Test-1776725349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:08:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6a75f64c-9965-40f4-9554-1d52dd72d00b tempest-GroupsV314Test-1776725349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a75f64c-9965-40f4-9554-1d52dd72d00b tempest-GroupsV314Test-1776725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:30 devstack sudo[94225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:08:30 devstack sudo[94225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:30 devstack sudo[94230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:08:30 devstack sudo[94230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:30 devstack sudo[94230]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a75f64c-9965-40f4-9554-1d52dd72d00b tempest-GroupsV314Test-1776725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.466s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:30 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-6a75f64c-9965-40f4-9554-1d52dd72d00b tempest-GroupsV314Test-1776725349 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:08:30 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6a75f64c-9965-40f4-9554-1d52dd72d00b tempest-GroupsV314Test-1776725349 None] Delete group completed successfully.
Nov 05 15:08:30 devstack sudo[94219]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:30 devstack sudo[94225]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-67aa6643-a4dc-4fc5-b674-c9cf052c271c 1073741824" returned: 0 in 0.982s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3d6e88b8-a70e-4d86-b71f-6704730d6198 tempest-ServerActionsTestOtherA-844328353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.575s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:30 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-3d6e88b8-a70e-4d86-b71f-6704730d6198 tempest-ServerActionsTestOtherA-844328353 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:08:30 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3d6e88b8-a70e-4d86-b71f-6704730d6198 tempest-ServerActionsTestOtherA-844328353 None] Deleted volume successfully.
Nov 05 15:08:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3d6e88b8-a70e-4d86-b71f-6704730d6198 tempest-ServerActionsTestOtherA-844328353 None] Lock "cinder-91989d49-c84f-4898-b4e6-706228ac19c0-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:08:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-67aa6643-a4dc-4fc5-b674-c9cf052c271c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:30 devstack sudo[94242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-67aa6643-a4dc-4fc5-b674-c9cf052c271c
Nov 05 15:08:30 devstack sudo[94242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:31 devstack sudo[94242]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-67aa6643-a4dc-4fc5-b674-c9cf052c271c" returned: 0 in 0.355s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:08:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a70a426-af32-47f6-a18b-70b6dd96223c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67aa6643-a4dc-4fc5-b674-c9cf052c271c', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c21a0f53-c53a-4160-a5b2-bd5cca89c6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:31 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Volume volume-67aa6643-a4dc-4fc5-b674-c9cf052c271c (67aa6643-a4dc-4fc5-b674-c9cf052c271c): created successfully
Nov 05 15:08:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c21a0f53-c53a-4160-a5b2-bd5cca89c6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Flow 'volume_create_manager' (e7f7fa57-5c59-48a6-ae04-ac3e03344b41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:08:31 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-03dde4f1-f239-40f6-807e-9d765f5dc5dd tempest-VolumesListAdminTestJSON-159991351 None] Created volume successfully.
Nov 05 15:08:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-de4a486b-0a23-4b02-84e1-96c4054e0680 tempest-GroupsV314Test-1776725349 None] Acquiring lock "cinder-quobyte-772580b9-af6d-490c-bcaa-7c54484e9953" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:08:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-de4a486b-0a23-4b02-84e1-96c4054e0680 tempest-GroupsV314Test-1776725349 None] Lock "cinder-quobyte-772580b9-af6d-490c-bcaa-7c54484e9953" acquired by "delete_volume" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:08:31 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecfe42f-9f71-429c-9e46-f33cef21aef7]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:08:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-de4a486b-0a23-4b02-84e1-96c4054e0680 tempest-GroupsV314Test-1776725349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:31 devstack sudo[94266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953
Nov 05 15:08:31 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:32 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-de4a486b-0a23-4b02-84e1-96c4054e0680 tempest-GroupsV314Test-1776725349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953" returned: 0 in 0.513s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-de4a486b-0a23-4b02-84e1-96c4054e0680 tempest-GroupsV314Test-1776725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:32 devstack sudo[94271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953
Nov 05 15:08:32 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Flow 'volume_create_manager' (29305212-98c8-496f-9c0c-8bd5b71f22fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec6d502-4a3a-4d5b-8b2e-519d098b4cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec6d502-4a3a-4d5b-8b2e-519d098b4cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-850122727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c66e30-f620-4072-b66d-15bf14e4c38a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7f2116ba624dda96376e9881b32eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:32Z,use_quota=True,user_id='67aea7e81e714b99a06ea42cb1def4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5351e45-0d8e-416b-a5b0-9a40d83709a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5351e45-0d8e-416b-a5b0-9a40d83709a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87a825e-bbd8-4605-8097-7ea6da52cf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87a825e-bbd8-4605-8097-7ea6da52cf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00c66e30-f620-4072-b66d-15bf14e4c38a', 'volume_name': 'volume-00c66e30-f620-4072-b66d-15bf14e4c38a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e8fde0-0339-424b-97d0-f8a2fbc8d5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e8fde0-0339-424b-97d0-f8a2fbc8d5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ef4753-bcd1-4945-b5c0-1603eb8aff1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:32 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Volume 00c66e30-f620-4072-b66d-15bf14e4c38a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00c66e30-f620-4072-b66d-15bf14e4c38a', 'volume_size': 1}
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-850122727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c66e30-f620-4072-b66d-15bf14e4c38a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7f2116ba624dda96376e9881b32eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:32Z,use_quota=True,user_id='67aea7e81e714b99a06ea42cb1def4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Creating volume 00c66e30-f620-4072-b66d-15bf14e4c38a {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:08:32 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00c66e30-f620-4072-b66d-15bf14e4c38a 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:32 devstack sudo[94274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00c66e30-f620-4072-b66d-15bf14e4c38a 1073741824
Nov 05 15:08:32 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:32 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-de4a486b-0a23-4b02-84e1-96c4054e0680 tempest-GroupsV314Test-1776725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-772580b9-af6d-490c-bcaa-7c54484e9953" returned: 0 in 0.410s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-de4a486b-0a23-4b02-84e1-96c4054e0680 tempest-GroupsV314Test-1776725349 None] Lock "cinder-quobyte-772580b9-af6d-490c-bcaa-7c54484e9953" released by "delete_volume" :: held 1.054s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-de4a486b-0a23-4b02-84e1-96c4054e0680 tempest-GroupsV314Test-1776725349 None] Created reservations ['a7a8bd58-79fa-48d3-abf4-f3b673ebc891'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:08:32 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-de4a486b-0a23-4b02-84e1-96c4054e0680 tempest-GroupsV314Test-1776725349 None] Created reservations ['8c147585-9074-4012-aae3-9f03df8ea152', '0a4ed53c-17b2-45a4-b590-8ff8905ccb11', 'e7f838b9-3d08-4beb-9f40-8930ff2617df', 'c6fe2b68-575f-4538-b281-b6c0bca8659d'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:08:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-de4a486b-0a23-4b02-84e1-96c4054e0680 tempest-GroupsV314Test-1776725349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-de4a486b-0a23-4b02-84e1-96c4054e0680 tempest-GroupsV314Test-1776725349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-de4a486b-0a23-4b02-84e1-96c4054e0680 tempest-GroupsV314Test-1776725349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:08:33 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-de4a486b-0a23-4b02-84e1-96c4054e0680 tempest-GroupsV314Test-1776725349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:08:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-de4a486b-0a23-4b02-84e1-96c4054e0680 tempest-GroupsV314Test-1776725349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-de4a486b-0a23-4b02-84e1-96c4054e0680 tempest-GroupsV314Test-1776725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00c66e30-f620-4072-b66d-15bf14e4c38a 1073741824" returned: 0 in 0.757s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:33 devstack sudo[94283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:08:33 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00c66e30-f620-4072-b66d-15bf14e4c38a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:33 devstack sudo[94285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00c66e30-f620-4072-b66d-15bf14e4c38a
Nov 05 15:08:33 devstack sudo[94285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:33 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-de4a486b-0a23-4b02-84e1-96c4054e0680 tempest-GroupsV314Test-1776725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.334s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:33 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-de4a486b-0a23-4b02-84e1-96c4054e0680 tempest-GroupsV314Test-1776725349 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:08:33 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-de4a486b-0a23-4b02-84e1-96c4054e0680 tempest-GroupsV314Test-1776725349 None] Delete group completed successfully.
Nov 05 15:08:33 devstack sudo[94285]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00c66e30-f620-4072-b66d-15bf14e4c38a" returned: 0 in 0.322s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:08:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ef4753-bcd1-4945-b5c0-1603eb8aff1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00c66e30-f620-4072-b66d-15bf14e4c38a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d51c9d-3f5a-4c40-8c65-f52219cabec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:33 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Volume volume-00c66e30-f620-4072-b66d-15bf14e4c38a (00c66e30-f620-4072-b66d-15bf14e4c38a): created successfully
Nov 05 15:08:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d51c9d-3f5a-4c40-8c65-f52219cabec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Flow 'volume_create_manager' (29305212-98c8-496f-9c0c-8bd5b71f22fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:08:33 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-179988b9-89a8-440b-aa0d-edd15e25c650 tempest-VolumesListAdminTestJSON-159991351 None] Created volume successfully.
Nov 05 15:08:35 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:08:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Flow 'volume_create_manager' (f4b4dd11-b74e-4426-8f99-ac5fc38eb015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:08:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65896dd2-3d0c-4f66-a2d2-aea79f206453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65896dd2-3d0c-4f66-a2d2-aea79f206453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c77953-82f1-46c2-a673-7e7360af2fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86c996b612234cce930dcab4c1a6cf87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:36Z,use_quota=True,user_id='a88bddc7287141ff8d24600ef3ce31b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb781ab-1397-49fd-ba2b-794fc5eb0354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb781ab-1397-49fd-ba2b-794fc5eb0354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91e2d43-4d69-4332-b354-e2a1edcce72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91e2d43-4d69-4332-b354-e2a1edcce72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94c77953-82f1-46c2-a673-7e7360af2fc1', 'volume_name': 'volume-94c77953-82f1-46c2-a673-7e7360af2fc1', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab84ab5-67f3-4894-8d9a-f61ee3c54bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab84ab5-67f3-4894-8d9a-f61ee3c54bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3cf90a-6e0e-4570-9255-540ca9ae0431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:35 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Volume 94c77953-82f1-46c2-a673-7e7360af2fc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94c77953-82f1-46c2-a673-7e7360af2fc1', 'volume_size': 1}
Nov 05 15:08:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c77953-82f1-46c2-a673-7e7360af2fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86c996b612234cce930dcab4c1a6cf87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:36Z,use_quota=True,user_id='a88bddc7287141ff8d24600ef3ce31b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:08:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Creating volume 94c77953-82f1-46c2-a673-7e7360af2fc1 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:08:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:08:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:08:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:08:35 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:08:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-94c77953-82f1-46c2-a673-7e7360af2fc1 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:36 devstack sudo[94356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-94c77953-82f1-46c2-a673-7e7360af2fc1 1073741824
Nov 05 15:08:36 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:36 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-94c77953-82f1-46c2-a673-7e7360af2fc1 1073741824" returned: 0 in 0.805s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-94c77953-82f1-46c2-a673-7e7360af2fc1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:36 devstack sudo[94364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-94c77953-82f1-46c2-a673-7e7360af2fc1
Nov 05 15:08:36 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:37 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-94c77953-82f1-46c2-a673-7e7360af2fc1" returned: 0 in 0.414s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:08:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3cf90a-6e0e-4570-9255-540ca9ae0431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94c77953-82f1-46c2-a673-7e7360af2fc1', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980c2cdd-07f7-4e3f-b697-3d69cd552de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:37 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Volume volume-94c77953-82f1-46c2-a673-7e7360af2fc1 (94c77953-82f1-46c2-a673-7e7360af2fc1): created successfully
Nov 05 15:08:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980c2cdd-07f7-4e3f-b697-3d69cd552de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Flow 'volume_create_manager' (f4b4dd11-b74e-4426-8f99-ac5fc38eb015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:08:37 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d22b738a-aee6-49dd-a0dc-d1448a069b74 tempest-VolumesListAdminTestJSON-88470413 None] Created volume successfully.
Nov 05 15:08:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:08:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:08:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:08:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:37 devstack sudo[94368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:08:37 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:37 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.476s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:08:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:08:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 15:08:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread info: [<_MainThread(MainThread, started 136317437956224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136317326340928)>, <Thread(Thread-3 (stat_writer), started daemon 136317326487936)>, <Thread(Rabbit-heartbeat, started daemon 136317321464000)>, <Thread(Thread-5 (_runner), started daemon 136317321550592)>, <Thread(Thread-7 (_runner), started daemon 136317321658496)>, <Thread(fd_logger, started daemon 136317319612992)>, <Thread(privsep_reader, started daemon 136317319622400)>, <Thread(tpool_thread_0, started daemon 136317310928576)>, <Thread(tpool_thread_1, started daemon 136317302535872)>, <Thread(tpool_thread_2, started daemon 136317294143168)>, <Thread(tpool_thread_3, started daemon 136317285750464)>, <Thread(tpool_thread_4, started daemon 136317277357760)>, <Thread(tpool_thread_5, started daemon 136317268965056)>, <Thread(tpool_thread_6, started daemon 136317260572352)>, <Thread(tpool_thread_7, started daemon 136317252179648)>, <Thread(tpool_thread_8, started daemon 136317243786944)>, <Thread(tpool_thread_9, started daemon 136317235394240)>, <Thread(tpool_thread_10, started daemon 136317227001536)>, <Thread(tpool_thread_11, started daemon 136317218608832)>, <Thread(tpool_thread_12, started daemon 136317210216128)>, <Thread(tpool_thread_13, started daemon 136317201807040)>, <Thread(tpool_thread_14, started daemon 136317193397952)>, <Thread(tpool_thread_15, started daemon 136317184988864)>, <Thread(tpool_thread_16, started daemon 136317176579776)>, <Thread(tpool_thread_17, started daemon 136317168170688)>, <Thread(tpool_thread_18, started daemon 136317159761600)>, <Thread(tpool_thread_19, started daemon 136317151352512)>] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 15:08:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-30ed11ff-91f0-4162-ad92-c89debbdd120 tempest-VolumesListAdminTestJSON-88470413 None] Acquiring lock "cinder-94c77953-82f1-46c2-a673-7e7360af2fc1-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:08:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-30ed11ff-91f0-4162-ad92-c89debbdd120 tempest-VolumesListAdminTestJSON-88470413 None] Lock "cinder-94c77953-82f1-46c2-a673-7e7360af2fc1-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:08:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-30ed11ff-91f0-4162-ad92-c89debbdd120 tempest-VolumesListAdminTestJSON-88470413 None] Acquiring lock "cinder-quobyte-94c77953-82f1-46c2-a673-7e7360af2fc1" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:08:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-30ed11ff-91f0-4162-ad92-c89debbdd120 tempest-VolumesListAdminTestJSON-88470413 None] Lock "cinder-quobyte-94c77953-82f1-46c2-a673-7e7360af2fc1" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:08:38 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2b0acd-69b2-4324-bd41-e32fbfb87ae9]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:08:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-30ed11ff-91f0-4162-ad92-c89debbdd120 tempest-VolumesListAdminTestJSON-88470413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-94c77953-82f1-46c2-a673-7e7360af2fc1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c6783a1a-2bd3-4fb9-836f-636fb38a5bff tempest-VolumesListAdminTestJSON-159991351 None] Acquiring lock "cinder-00c66e30-f620-4072-b66d-15bf14e4c38a-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:08:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c6783a1a-2bd3-4fb9-836f-636fb38a5bff tempest-VolumesListAdminTestJSON-159991351 None] Lock "cinder-00c66e30-f620-4072-b66d-15bf14e4c38a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:08:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c6783a1a-2bd3-4fb9-836f-636fb38a5bff tempest-VolumesListAdminTestJSON-159991351 None] Acquiring lock "cinder-quobyte-00c66e30-f620-4072-b66d-15bf14e4c38a" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:08:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c6783a1a-2bd3-4fb9-836f-636fb38a5bff tempest-VolumesListAdminTestJSON-159991351 None] Lock "cinder-quobyte-00c66e30-f620-4072-b66d-15bf14e4c38a" acquired by "delete_volume" :: waited 0.057s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:08:38 devstack sudo[94372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-94c77953-82f1-46c2-a673-7e7360af2fc1
Nov 05 15:08:38 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:38 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbd59cb-9e5e-4854-9b4d-bd7763e57c98]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:08:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c6783a1a-2bd3-4fb9-836f-636fb38a5bff tempest-VolumesListAdminTestJSON-159991351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00c66e30-f620-4072-b66d-15bf14e4c38a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:38 devstack sudo[94375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00c66e30-f620-4072-b66d-15bf14e4c38a
Nov 05 15:08:38 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:38 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-30ed11ff-91f0-4162-ad92-c89debbdd120 tempest-VolumesListAdminTestJSON-88470413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-94c77953-82f1-46c2-a673-7e7360af2fc1" returned: 0 in 0.575s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-30ed11ff-91f0-4162-ad92-c89debbdd120 tempest-VolumesListAdminTestJSON-88470413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-94c77953-82f1-46c2-a673-7e7360af2fc1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:38 devstack sudo[94380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-94c77953-82f1-46c2-a673-7e7360af2fc1
Nov 05 15:08:38 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:39 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c6783a1a-2bd3-4fb9-836f-636fb38a5bff tempest-VolumesListAdminTestJSON-159991351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00c66e30-f620-4072-b66d-15bf14e4c38a" returned: 0 in 0.670s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c6783a1a-2bd3-4fb9-836f-636fb38a5bff tempest-VolumesListAdminTestJSON-159991351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00c66e30-f620-4072-b66d-15bf14e4c38a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:39 devstack sudo[94385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00c66e30-f620-4072-b66d-15bf14e4c38a
Nov 05 15:08:39 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:39 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-30ed11ff-91f0-4162-ad92-c89debbdd120 tempest-VolumesListAdminTestJSON-88470413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-94c77953-82f1-46c2-a673-7e7360af2fc1" returned: 0 in 0.510s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-30ed11ff-91f0-4162-ad92-c89debbdd120 tempest-VolumesListAdminTestJSON-88470413 None] Lock "cinder-quobyte-94c77953-82f1-46c2-a673-7e7360af2fc1" released by "delete_volume" :: held 1.182s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:08:39 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=99,cinder:SELECT=103,cinder:INSERT=23,cinder:DELETE=3 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:08:39 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=99,cinder:INSERT=23,cinder:UPDATE=114,cinder:DELETE=9 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:08:39 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-30ed11ff-91f0-4162-ad92-c89debbdd120 tempest-VolumesListAdminTestJSON-88470413 None] Created reservations ['4bbf5583-46e9-40c8-9b59-4ba377f0cc00', '3bb6b270-c7ca-49bf-b5d8-cdd12cb5b9d7', 'c81abcfe-e03b-4195-bb00-fdde6ddbf7ee', 'a00764c6-1147-4044-88f5-094380819ed3'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:08:39 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c6783a1a-2bd3-4fb9-836f-636fb38a5bff tempest-VolumesListAdminTestJSON-159991351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00c66e30-f620-4072-b66d-15bf14e4c38a" returned: 0 in 0.522s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c6783a1a-2bd3-4fb9-836f-636fb38a5bff tempest-VolumesListAdminTestJSON-159991351 None] Lock "cinder-quobyte-00c66e30-f620-4072-b66d-15bf14e4c38a" released by "delete_volume" :: held 1.279s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:08:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-30ed11ff-91f0-4162-ad92-c89debbdd120 tempest-VolumesListAdminTestJSON-88470413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-30ed11ff-91f0-4162-ad92-c89debbdd120 tempest-VolumesListAdminTestJSON-88470413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-30ed11ff-91f0-4162-ad92-c89debbdd120 tempest-VolumesListAdminTestJSON-88470413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:08:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-30ed11ff-91f0-4162-ad92-c89debbdd120 tempest-VolumesListAdminTestJSON-88470413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:08:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-30ed11ff-91f0-4162-ad92-c89debbdd120 tempest-VolumesListAdminTestJSON-88470413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-30ed11ff-91f0-4162-ad92-c89debbdd120 tempest-VolumesListAdminTestJSON-88470413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:39 devstack sudo[94389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:08:39 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:39 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-c6783a1a-2bd3-4fb9-836f-636fb38a5bff tempest-VolumesListAdminTestJSON-159991351 None] Created reservations ['f47ce3bc-66e9-4c68-8f39-5fd6dc488732', '1167af0d-79a8-49c0-925b-87bb25c8d0f8', 'dfacd85d-c2ac-4aff-93e9-6fa36f682d6c', '2caa5128-fb10-4cf5-bed9-ab8f9ea29554'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:08:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c6783a1a-2bd3-4fb9-836f-636fb38a5bff tempest-VolumesListAdminTestJSON-159991351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c6783a1a-2bd3-4fb9-836f-636fb38a5bff tempest-VolumesListAdminTestJSON-159991351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c6783a1a-2bd3-4fb9-836f-636fb38a5bff tempest-VolumesListAdminTestJSON-159991351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:08:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c6783a1a-2bd3-4fb9-836f-636fb38a5bff tempest-VolumesListAdminTestJSON-159991351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:08:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c6783a1a-2bd3-4fb9-836f-636fb38a5bff tempest-VolumesListAdminTestJSON-159991351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c6783a1a-2bd3-4fb9-836f-636fb38a5bff tempest-VolumesListAdminTestJSON-159991351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:40 devstack sudo[94391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:08:40 devstack sudo[94391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:40 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-30ed11ff-91f0-4162-ad92-c89debbdd120 tempest-VolumesListAdminTestJSON-88470413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.456s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:40 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-30ed11ff-91f0-4162-ad92-c89debbdd120 tempest-VolumesListAdminTestJSON-88470413 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:08:40 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-30ed11ff-91f0-4162-ad92-c89debbdd120 tempest-VolumesListAdminTestJSON-88470413 None] Deleted volume successfully.
Nov 05 15:08:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-30ed11ff-91f0-4162-ad92-c89debbdd120 tempest-VolumesListAdminTestJSON-88470413 None] Lock "cinder-94c77953-82f1-46c2-a673-7e7360af2fc1-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:08:40 devstack sudo[94391]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c6783a1a-2bd3-4fb9-836f-636fb38a5bff tempest-VolumesListAdminTestJSON-159991351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.474s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:40 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-c6783a1a-2bd3-4fb9-836f-636fb38a5bff tempest-VolumesListAdminTestJSON-159991351 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:08:40 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c6783a1a-2bd3-4fb9-836f-636fb38a5bff tempest-VolumesListAdminTestJSON-159991351 None] Deleted volume successfully.
Nov 05 15:08:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c6783a1a-2bd3-4fb9-836f-636fb38a5bff tempest-VolumesListAdminTestJSON-159991351 None] Lock "cinder-00c66e30-f620-4072-b66d-15bf14e4c38a-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:08:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9c845515-2ba7-4c4e-96aa-653bb08a7f99 tempest-VolumesListAdminTestJSON-159991351 None] Acquiring lock "cinder-67aa6643-a4dc-4fc5-b674-c9cf052c271c-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:08:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9c845515-2ba7-4c4e-96aa-653bb08a7f99 tempest-VolumesListAdminTestJSON-159991351 None] Lock "cinder-67aa6643-a4dc-4fc5-b674-c9cf052c271c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:08:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9c845515-2ba7-4c4e-96aa-653bb08a7f99 tempest-VolumesListAdminTestJSON-159991351 None] Acquiring lock "cinder-quobyte-67aa6643-a4dc-4fc5-b674-c9cf052c271c" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:08:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9c845515-2ba7-4c4e-96aa-653bb08a7f99 tempest-VolumesListAdminTestJSON-159991351 None] Lock "cinder-quobyte-67aa6643-a4dc-4fc5-b674-c9cf052c271c" acquired by "delete_volume" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:08:41 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb39d68-8c94-42bf-b052-d3ddfa8ace8b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:08:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9c845515-2ba7-4c4e-96aa-653bb08a7f99 tempest-VolumesListAdminTestJSON-159991351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-67aa6643-a4dc-4fc5-b674-c9cf052c271c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:41 devstack sudo[94395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-67aa6643-a4dc-4fc5-b674-c9cf052c271c
Nov 05 15:08:41 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:41 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9c845515-2ba7-4c4e-96aa-653bb08a7f99 tempest-VolumesListAdminTestJSON-159991351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-67aa6643-a4dc-4fc5-b674-c9cf052c271c" returned: 0 in 0.630s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9c845515-2ba7-4c4e-96aa-653bb08a7f99 tempest-VolumesListAdminTestJSON-159991351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-67aa6643-a4dc-4fc5-b674-c9cf052c271c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:41 devstack sudo[94401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-67aa6643-a4dc-4fc5-b674-c9cf052c271c
Nov 05 15:08:41 devstack sudo[94401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:42 devstack sudo[94401]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9c845515-2ba7-4c4e-96aa-653bb08a7f99 tempest-VolumesListAdminTestJSON-159991351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-67aa6643-a4dc-4fc5-b674-c9cf052c271c" returned: 0 in 0.617s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9c845515-2ba7-4c4e-96aa-653bb08a7f99 tempest-VolumesListAdminTestJSON-159991351 None] Lock "cinder-quobyte-67aa6643-a4dc-4fc5-b674-c9cf052c271c" released by "delete_volume" :: held 1.326s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:08:42 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-9c845515-2ba7-4c4e-96aa-653bb08a7f99 tempest-VolumesListAdminTestJSON-159991351 None] Created reservations ['a2dddb78-5181-4ad6-aac0-6f4743627268', '0f37ce2f-2a7f-407f-87ff-a2274c1eb650', 'e893b15f-9fff-4ff0-9db8-2fd69b82c6a6', '2cae941b-5249-41f2-9b18-75c4b2d97bb8'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:08:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9c845515-2ba7-4c4e-96aa-653bb08a7f99 tempest-VolumesListAdminTestJSON-159991351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9c845515-2ba7-4c4e-96aa-653bb08a7f99 tempest-VolumesListAdminTestJSON-159991351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9c845515-2ba7-4c4e-96aa-653bb08a7f99 tempest-VolumesListAdminTestJSON-159991351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:08:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9c845515-2ba7-4c4e-96aa-653bb08a7f99 tempest-VolumesListAdminTestJSON-159991351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:08:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9c845515-2ba7-4c4e-96aa-653bb08a7f99 tempest-VolumesListAdminTestJSON-159991351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9c845515-2ba7-4c4e-96aa-653bb08a7f99 tempest-VolumesListAdminTestJSON-159991351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:42 devstack sudo[94406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:08:42 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:43 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9c845515-2ba7-4c4e-96aa-653bb08a7f99 tempest-VolumesListAdminTestJSON-159991351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.559s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:43 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-9c845515-2ba7-4c4e-96aa-653bb08a7f99 tempest-VolumesListAdminTestJSON-159991351 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:08:43 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9c845515-2ba7-4c4e-96aa-653bb08a7f99 tempest-VolumesListAdminTestJSON-159991351 None] Deleted volume successfully.
Nov 05 15:08:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9c845515-2ba7-4c4e-96aa-653bb08a7f99 tempest-VolumesListAdminTestJSON-159991351 None] Lock "cinder-67aa6643-a4dc-4fc5-b674-c9cf052c271c-delete_volume" released by "delete_volume" :: held 2.221s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:08:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bd4fbf44-3b13-49ed-8f07-7cd6f4263c0e tempest-VolumesListAdminTestJSON-159991351 None] Acquiring lock "cinder-5ad7f6a5-f733-4594-8116-4f659813aa0a-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:08:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bd4fbf44-3b13-49ed-8f07-7cd6f4263c0e tempest-VolumesListAdminTestJSON-159991351 None] Lock "cinder-5ad7f6a5-f733-4594-8116-4f659813aa0a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:08:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bd4fbf44-3b13-49ed-8f07-7cd6f4263c0e tempest-VolumesListAdminTestJSON-159991351 None] Acquiring lock "cinder-quobyte-5ad7f6a5-f733-4594-8116-4f659813aa0a" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:08:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bd4fbf44-3b13-49ed-8f07-7cd6f4263c0e tempest-VolumesListAdminTestJSON-159991351 None] Lock "cinder-quobyte-5ad7f6a5-f733-4594-8116-4f659813aa0a" acquired by "delete_volume" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:08:43 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[60771f16-fb37-4262-9c9e-9058d00b238e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:08:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bd4fbf44-3b13-49ed-8f07-7cd6f4263c0e tempest-VolumesListAdminTestJSON-159991351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5ad7f6a5-f733-4594-8116-4f659813aa0a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:43 devstack sudo[94410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5ad7f6a5-f733-4594-8116-4f659813aa0a
Nov 05 15:08:43 devstack sudo[94410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:44 devstack sudo[94410]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bd4fbf44-3b13-49ed-8f07-7cd6f4263c0e tempest-VolumesListAdminTestJSON-159991351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5ad7f6a5-f733-4594-8116-4f659813aa0a" returned: 0 in 0.529s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bd4fbf44-3b13-49ed-8f07-7cd6f4263c0e tempest-VolumesListAdminTestJSON-159991351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5ad7f6a5-f733-4594-8116-4f659813aa0a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:44 devstack sudo[94416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5ad7f6a5-f733-4594-8116-4f659813aa0a
Nov 05 15:08:44 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:44 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bd4fbf44-3b13-49ed-8f07-7cd6f4263c0e tempest-VolumesListAdminTestJSON-159991351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5ad7f6a5-f733-4594-8116-4f659813aa0a" returned: 0 in 0.399s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bd4fbf44-3b13-49ed-8f07-7cd6f4263c0e tempest-VolumesListAdminTestJSON-159991351 None] Lock "cinder-quobyte-5ad7f6a5-f733-4594-8116-4f659813aa0a" released by "delete_volume" :: held 0.989s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:08:44 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-bd4fbf44-3b13-49ed-8f07-7cd6f4263c0e tempest-VolumesListAdminTestJSON-159991351 None] Created reservations ['2cdedc45-019f-42ca-b614-7b46f8d1dbbe', 'd78c8281-dc42-4663-8133-0e5488b030b5', '4186b3bb-ca4a-46cc-939a-a86c16106df8', 'c37a8f15-afac-4b50-b9a7-da593f24da38'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:08:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bd4fbf44-3b13-49ed-8f07-7cd6f4263c0e tempest-VolumesListAdminTestJSON-159991351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bd4fbf44-3b13-49ed-8f07-7cd6f4263c0e tempest-VolumesListAdminTestJSON-159991351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bd4fbf44-3b13-49ed-8f07-7cd6f4263c0e tempest-VolumesListAdminTestJSON-159991351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:08:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bd4fbf44-3b13-49ed-8f07-7cd6f4263c0e tempest-VolumesListAdminTestJSON-159991351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:08:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bd4fbf44-3b13-49ed-8f07-7cd6f4263c0e tempest-VolumesListAdminTestJSON-159991351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bd4fbf44-3b13-49ed-8f07-7cd6f4263c0e tempest-VolumesListAdminTestJSON-159991351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:44 devstack sudo[94419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:08:44 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:44 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bd4fbf44-3b13-49ed-8f07-7cd6f4263c0e tempest-VolumesListAdminTestJSON-159991351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.311s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:45 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-bd4fbf44-3b13-49ed-8f07-7cd6f4263c0e tempest-VolumesListAdminTestJSON-159991351 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:08:45 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-bd4fbf44-3b13-49ed-8f07-7cd6f4263c0e tempest-VolumesListAdminTestJSON-159991351 None] Deleted volume successfully.
Nov 05 15:08:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bd4fbf44-3b13-49ed-8f07-7cd6f4263c0e tempest-VolumesListAdminTestJSON-159991351 None] Lock "cinder-5ad7f6a5-f733-4594-8116-4f659813aa0a-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:08:53 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:08:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Flow 'volume_create_manager' (6cab22ce-9d42-4dbe-a692-cd15b8161494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:08:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8c92ed-68ce-4275-b969-ad943d3638e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8c92ed-68ce-4275-b969-ad943d3638e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1188198170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98f1731-b0d2-4054-9980-71431c7b6f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4e2a101f224747916a6722e7ed00dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:54Z,use_quota=True,user_id='6e0c6f667dbc4fc58f5b81e7f61b8798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e107eecc-eb58-4cc8-8057-4aa83c6f5bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e107eecc-eb58-4cc8-8057-4aa83c6f5bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501bef3d-1845-4119-956a-f0a6c65808db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:53 devstack cinder-volume[87150]: DEBUG cinder.image.glance [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Creating Keystone auth plugin from conf {{(pid=87150) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 15:08:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501bef3d-1845-4119-956a-f0a6c65808db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b98f1731-b0d2-4054-9980-71431c7b6f6f', 'volume_name': 'volume-b98f1731-b0d2-4054-9980-71431c7b6f6f', 'volume_size': 1, 'image_id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4a6a2406cd83415e894eebbb1d6b51ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'created_at': datetime.datetime(2026, 11, 5, 13, 57, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21a5d804-2425-4adb-8e07-60d978b4be84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfad8f5f1a0>}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66be05a-f3a7-4026-94b4-887e39d31477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66be05a-f3a7-4026-94b4-887e39d31477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:08:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f762b71-abb5-43e9-a9c2-6c7c31de4870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:08:54 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Volume b98f1731-b0d2-4054-9980-71431c7b6f6f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b98f1731-b0d2-4054-9980-71431c7b6f6f', 'volume_size': 1, 'image_id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4a6a2406cd83415e894eebbb1d6b51ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'created_at': datetime.datetime(2026, 11, 5, 13, 57, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21a5d804-2425-4adb-8e07-60d978b4be84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfad8f5f1a0>}
Nov 05 15:08:54 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Trying to clone b98f1731-b0d2-4054-9980-71431c7b6f6f from image 21a5d804-2425-4adb-8e07-60d978b4be84 at location (None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}]). {{(pid=87150) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 15:08:55 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_7qvkl04wdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 15:08:55 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 15:08:55 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bbe9a1-ae75-40de-8531-5a4503e41fd6]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:08:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_7qvkl04wdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:55 devstack sudo[94442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_7qvkl04wdevstack@QuobyteHD
Nov 05 15:08:55 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:55 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_7qvkl04wdevstack@QuobyteHD" returned: 0 in 0.592s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:55 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Temporary image 21a5d804-2425-4adb-8e07-60d978b4be84 is fetched for user 6e0c6f667dbc4fc58f5b81e7f61b8798. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 15:08:55 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e67f3f-5c8f-4819-b3e4-b141ab8162ad]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:08:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_7qvkl04wdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:56 devstack sudo[94447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_7qvkl04wdevstack@QuobyteHD
Nov 05 15:08:56 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:56 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_7qvkl04wdevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1188198170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98f1731-b0d2-4054-9980-71431c7b6f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4e2a101f224747916a6722e7ed00dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:54Z,use_quota=True,user_id='6e0c6f667dbc4fc58f5b81e7f61b8798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:08:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Creating volume b98f1731-b0d2-4054-9980-71431c7b6f6f {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:08:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:08:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:08:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:08:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:08:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:08:56 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:08:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b98f1731-b0d2-4054-9980-71431c7b6f6f 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:56 devstack sudo[94452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b98f1731-b0d2-4054-9980-71431c7b6f6f 1073741824
Nov 05 15:08:56 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:56 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b98f1731-b0d2-4054-9980-71431c7b6f6f 1073741824" returned: 0 in 0.587s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b98f1731-b0d2-4054-9980-71431c7b6f6f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:56 devstack sudo[94458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b98f1731-b0d2-4054-9980-71431c7b6f6f
Nov 05 15:08:56 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:57 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b98f1731-b0d2-4054-9980-71431c7b6f6f" returned: 0 in 0.264s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:08:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:08:57 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Attempting download of 21a5d804-2425-4adb-8e07-60d978b4be84 ((None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}])) to volume b98f1731-b0d2-4054-9980-71431c7b6f6f. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 15:08:57 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8924a3f8-ac61-4e51-9cb5-f5dd68e8b17d]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:08:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_wj7_t_70 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:57 devstack sudo[94461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_wj7_t_70
Nov 05 15:08:57 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:57 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_wj7_t_70" returned: 0 in 0.388s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_wj7_t_70 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:57 devstack sudo[94465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_wj7_t_70
Nov 05 15:08:57 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:58 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_wj7_t_70" returned: 1 in 0.381s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_wj7_t_70' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 15:08:58 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d67405-0442-42af-b8e7-b9f15e179ee7]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:08:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_7qvkl04wdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:58 devstack sudo[94469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_7qvkl04wdevstack@QuobyteHD
Nov 05 15:08:58 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:08:58 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root
Nov 05 15:08:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_7qvkl04wdevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:08:58 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] 21a5d804-2425-4adb-8e07-60d978b4be84 was qcow2, converting to qcow2 {{(pid=87150) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 15:08:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_7qvkl04wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b98f1731-b0d2-4054-9980-71431c7b6f6f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:08:58 devstack sudo[94476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_7qvkl04wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b98f1731-b0d2-4054-9980-71431c7b6f6f
Nov 05 15:08:58 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:00 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_7qvkl04wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b98f1731-b0d2-4054-9980-71431c7b6f6f" returned: 0 in 2.336s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:00 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_7qvkl04wdevstack@QuobyteHD, size 112.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b98f1731-b0d2-4054-9980-71431c7b6f6f {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:09:00 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Converted 112.00 MB image at 47.92 MB/s
Nov 05 15:09:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b98f1731-b0d2-4054-9980-71431c7b6f6f 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:00 devstack sudo[94484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b98f1731-b0d2-4054-9980-71431c7b6f6f 1G
Nov 05 15:09:00 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:01 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b98f1731-b0d2-4054-9980-71431c7b6f6f 1G" returned: 0 in 0.407s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:01 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Downloaded image 21a5d804-2425-4adb-8e07-60d978b4be84 ((None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}])) to volume b98f1731-b0d2-4054-9980-71431c7b6f6f successfully. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 15:09:01 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Temporary image 21a5d804-2425-4adb-8e07-60d978b4be84 for user 6e0c6f667dbc4fc58f5b81e7f61b8798 is deleted. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 15:09:01 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Marking volume b98f1731-b0d2-4054-9980-71431c7b6f6f as bootable. {{(pid=87150) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 15:09:01 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Copying metadata from image 21a5d804-2425-4adb-8e07-60d978b4be84 to b98f1731-b0d2-4054-9980-71431c7b6f6f. {{(pid=87150) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 15:09:01 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Creating volume glance metadata for volume b98f1731-b0d2-4054-9980-71431c7b6f6f backed by image 21a5d804-2425-4adb-8e07-60d978b4be84 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87150) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 15:09:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f762b71-abb5-43e9-a9c2-6c7c31de4870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b98f1731-b0d2-4054-9980-71431c7b6f6f', 'volume_size': 1, 'image_id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4a6a2406cd83415e894eebbb1d6b51ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'created_at': datetime.datetime(2026, 11, 5, 13, 57, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21a5d804-2425-4adb-8e07-60d978b4be84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfad8f5f1a0>}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73ce8f5c-d4d0-42b1-982b-33cd58f610a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:01 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Volume volume-b98f1731-b0d2-4054-9980-71431c7b6f6f (b98f1731-b0d2-4054-9980-71431c7b6f6f): created successfully
Nov 05 15:09:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73ce8f5c-d4d0-42b1-982b-33cd58f610a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Flow 'volume_create_manager' (6cab22ce-9d42-4dbe-a692-cd15b8161494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:09:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-45e905e0-a58e-40c4-89e5-f692de4a2022 tempest-VolumesImageMetadata-131950664 None] Created volume successfully.
Nov 05 15:09:02 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:09:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Flow 'volume_create_manager' (f1c78c70-a33d-4f77-af70-ca2c9f817c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:09:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2125dbaa-e7d7-44b7-a994-d69f3ee64443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2125dbaa-e7d7-44b7-a994-d69f3ee64443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-801212672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9559fed-0cc3-4182-abb9-8d24103d1bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbac5bd198a542d7b67c1150f89a8674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:02Z,use_quota=True,user_id='a9a20ed2c3494d3e8d67ce6462d5d90c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (768f199f-e973-4ad7-b23f-a8cced5e6e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (768f199f-e973-4ad7-b23f-a8cced5e6e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b53ec0c-299a-4179-8a79-2a49b5b39ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b53ec0c-299a-4179-8a79-2a49b5b39ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9559fed-0cc3-4182-abb9-8d24103d1bad', 'volume_name': 'volume-c9559fed-0cc3-4182-abb9-8d24103d1bad', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83fb715-5186-4f20-9e7f-38d24cdb26a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83fb715-5186-4f20-9e7f-38d24cdb26a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ab0c8b-151b-4a4b-8527-7b265614e1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:02 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Volume c9559fed-0cc3-4182-abb9-8d24103d1bad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9559fed-0cc3-4182-abb9-8d24103d1bad', 'volume_size': 1}
Nov 05 15:09:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-801212672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9559fed-0cc3-4182-abb9-8d24103d1bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbac5bd198a542d7b67c1150f89a8674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:02Z,use_quota=True,user_id='a9a20ed2c3494d3e8d67ce6462d5d90c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:09:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Creating volume c9559fed-0cc3-4182-abb9-8d24103d1bad {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:09:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:09:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:09:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:09:02 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:09:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c9559fed-0cc3-4182-abb9-8d24103d1bad 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:02 devstack sudo[94492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c9559fed-0cc3-4182-abb9-8d24103d1bad 1073741824
Nov 05 15:09:02 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:02 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c9559fed-0cc3-4182-abb9-8d24103d1bad 1073741824" returned: 0 in 0.630s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c9559fed-0cc3-4182-abb9-8d24103d1bad {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:02 devstack sudo[94497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c9559fed-0cc3-4182-abb9-8d24103d1bad
Nov 05 15:09:02 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-96d63137-e19d-4006-adfc-c4a0b7fc376d tempest-VolumesImageMetadata-131950664 None] Acquiring lock "cinder-b98f1731-b0d2-4054-9980-71431c7b6f6f-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-96d63137-e19d-4006-adfc-c4a0b7fc376d tempest-VolumesImageMetadata-131950664 None] Lock "cinder-b98f1731-b0d2-4054-9980-71431c7b6f6f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-96d63137-e19d-4006-adfc-c4a0b7fc376d tempest-VolumesImageMetadata-131950664 None] Acquiring lock "cinder-quobyte-b98f1731-b0d2-4054-9980-71431c7b6f6f" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:03 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c9559fed-0cc3-4182-abb9-8d24103d1bad" returned: 0 in 0.360s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ab0c8b-151b-4a4b-8527-7b265614e1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9559fed-0cc3-4182-abb9-8d24103d1bad', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5304e274-3a0a-42d8-99fc-60c6e143228c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-96d63137-e19d-4006-adfc-c4a0b7fc376d tempest-VolumesImageMetadata-131950664 None] Lock "cinder-quobyte-b98f1731-b0d2-4054-9980-71431c7b6f6f" acquired by "delete_volume" :: waited 0.061s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:03 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Volume volume-c9559fed-0cc3-4182-abb9-8d24103d1bad (c9559fed-0cc3-4182-abb9-8d24103d1bad): created successfully
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5304e274-3a0a-42d8-99fc-60c6e143228c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Flow 'volume_create_manager' (f1c78c70-a33d-4f77-af70-ca2c9f817c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[321995be-ab62-411d-9db8-d1232c25ca9e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-96d63137-e19d-4006-adfc-c4a0b7fc376d tempest-VolumesImageMetadata-131950664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b98f1731-b0d2-4054-9980-71431c7b6f6f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2e490e45-9a12-4b3c-9c7d-a43b00c29a51 tempest-AttachVolumeNegativeTest-1140258724 None] Created volume successfully.
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:09:03 devstack sudo[94500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b98f1731-b0d2-4054-9980-71431c7b6f6f
Nov 05 15:09:03 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Flow 'volume_create_manager' (9690aa35-162c-48bc-81cc-98744c16c884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (941835f0-b0a4-4dce-88e2-6798fa43b082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (941835f0-b0a4-4dce-88e2-6798fa43b082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1704846532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6315281d-99ba-453c-ac0a-c2756f0bb842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126e1ef06bd44a2b8fc2e5eb67181bd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:03Z,use_quota=True,user_id='c82b7d803e8f4a919ceb798d59575fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d527696-3691-46b2-be6e-a05b9fe835b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d527696-3691-46b2-be6e-a05b9fe835b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f109d6-14c7-4694-b0c9-be2a4b8d2b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f109d6-14c7-4694-b0c9-be2a4b8d2b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6315281d-99ba-453c-ac0a-c2756f0bb842', 'volume_name': 'volume-6315281d-99ba-453c-ac0a-c2756f0bb842', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f9a089-76fb-430c-9a4c-684889b08bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f9a089-76fb-430c-9a4c-684889b08bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c176a6f1-ac07-4399-ab56-edc9fab66968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:03 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Volume 6315281d-99ba-453c-ac0a-c2756f0bb842: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6315281d-99ba-453c-ac0a-c2756f0bb842', 'volume_size': 1}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1704846532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6315281d-99ba-453c-ac0a-c2756f0bb842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126e1ef06bd44a2b8fc2e5eb67181bd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:03Z,use_quota=True,user_id='c82b7d803e8f4a919ceb798d59575fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Creating volume 6315281d-99ba-453c-ac0a-c2756f0bb842 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:09:03 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6315281d-99ba-453c-ac0a-c2756f0bb842 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:03 devstack sudo[94502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6315281d-99ba-453c-ac0a-c2756f0bb842 1073741824
Nov 05 15:09:03 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:03 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-96d63137-e19d-4006-adfc-c4a0b7fc376d tempest-VolumesImageMetadata-131950664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b98f1731-b0d2-4054-9980-71431c7b6f6f" returned: 0 in 0.406s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-96d63137-e19d-4006-adfc-c4a0b7fc376d tempest-VolumesImageMetadata-131950664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b98f1731-b0d2-4054-9980-71431c7b6f6f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:03 devstack sudo[94507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b98f1731-b0d2-4054-9980-71431c7b6f6f
Nov 05 15:09:03 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:04 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-96d63137-e19d-4006-adfc-c4a0b7fc376d tempest-VolumesImageMetadata-131950664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b98f1731-b0d2-4054-9980-71431c7b6f6f" returned: 0 in 0.251s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-96d63137-e19d-4006-adfc-c4a0b7fc376d tempest-VolumesImageMetadata-131950664 None] Lock "cinder-quobyte-b98f1731-b0d2-4054-9980-71431c7b6f6f" released by "delete_volume" :: held 0.731s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:04 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-96d63137-e19d-4006-adfc-c4a0b7fc376d tempest-VolumesImageMetadata-131950664 None] Created reservations ['bf188900-6618-4165-8fa1-849bea7dd1c3', 'b097f361-71e8-4b4e-884c-282480b2882b', '7b4ceb7a-8cad-4e3e-bbc5-8efbf396a6b0', '821a534d-a1e2-4e3f-86bf-2c7ca29cfcc5'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:09:04 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6315281d-99ba-453c-ac0a-c2756f0bb842 1073741824" returned: 0 in 0.523s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6315281d-99ba-453c-ac0a-c2756f0bb842 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-96d63137-e19d-4006-adfc-c4a0b7fc376d tempest-VolumesImageMetadata-131950664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-96d63137-e19d-4006-adfc-c4a0b7fc376d tempest-VolumesImageMetadata-131950664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-96d63137-e19d-4006-adfc-c4a0b7fc376d tempest-VolumesImageMetadata-131950664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:09:04 devstack sudo[94514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6315281d-99ba-453c-ac0a-c2756f0bb842
Nov 05 15:09:04 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-96d63137-e19d-4006-adfc-c4a0b7fc376d tempest-VolumesImageMetadata-131950664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:09:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-96d63137-e19d-4006-adfc-c4a0b7fc376d tempest-VolumesImageMetadata-131950664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-96d63137-e19d-4006-adfc-c4a0b7fc376d tempest-VolumesImageMetadata-131950664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:04 devstack sudo[94516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:09:04 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:04 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6315281d-99ba-453c-ac0a-c2756f0bb842" returned: 0 in 0.380s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:09:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c176a6f1-ac07-4399-ab56-edc9fab66968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6315281d-99ba-453c-ac0a-c2756f0bb842', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0f174f-03c8-4648-9e9c-8d74f641d37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:04 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Volume volume-6315281d-99ba-453c-ac0a-c2756f0bb842 (6315281d-99ba-453c-ac0a-c2756f0bb842): created successfully
Nov 05 15:09:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0f174f-03c8-4648-9e9c-8d74f641d37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Flow 'volume_create_manager' (9690aa35-162c-48bc-81cc-98744c16c884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:09:04 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-96d63137-e19d-4006-adfc-c4a0b7fc376d tempest-VolumesImageMetadata-131950664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.472s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:04 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-96d63137-e19d-4006-adfc-c4a0b7fc376d tempest-VolumesImageMetadata-131950664 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:09:04 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-05ac575f-de3c-4bd0-b79d-61ac50851fcd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Created volume successfully.
Nov 05 15:09:04 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-96d63137-e19d-4006-adfc-c4a0b7fc376d tempest-VolumesImageMetadata-131950664 None] Deleted volume successfully.
Nov 05 15:09:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-96d63137-e19d-4006-adfc-c4a0b7fc376d tempest-VolumesImageMetadata-131950664 None] Lock "cinder-b98f1731-b0d2-4054-9980-71431c7b6f6f-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-0b0f2012-8daf-402c-8992-331b86699560 req-8c9bc385-71c3-4ae5-8a4b-f7dca424c86b tempest-AttachVolumeNegativeTest-1140258724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-0b0f2012-8daf-402c-8992-331b86699560 req-8c9bc385-71c3-4ae5-8a4b-f7dca424c86b tempest-AttachVolumeNegativeTest-1140258724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-0b0f2012-8daf-402c-8992-331b86699560 req-8c9bc385-71c3-4ae5-8a4b-f7dca424c86b tempest-AttachVolumeNegativeTest-1140258724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-0b0f2012-8daf-402c-8992-331b86699560 req-8c9bc385-71c3-4ae5-8a4b-f7dca424c86b tempest-AttachVolumeNegativeTest-1140258724 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628', 'name': 'volume-c9559fed-0cc3-4182-abb9-8d24103d1bad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f5f9e72-4f1c-494d-95e4-ae4f0a37b96f', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 15:09:05 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-0b0f2012-8daf-402c-8992-331b86699560 req-8c9bc385-71c3-4ae5-8a4b-f7dca424c86b tempest-AttachVolumeNegativeTest-1140258724 None] attachment_update completed successfully.
Nov 05 15:09:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5ed9e755-dced-421b-8746-f410e24d933c tempest-VolumeQuotasAdminTestJSON-1612724277 None] Acquiring lock "cinder-6315281d-99ba-453c-ac0a-c2756f0bb842-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5ed9e755-dced-421b-8746-f410e24d933c tempest-VolumeQuotasAdminTestJSON-1612724277 None] Lock "cinder-6315281d-99ba-453c-ac0a-c2756f0bb842-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5ed9e755-dced-421b-8746-f410e24d933c tempest-VolumeQuotasAdminTestJSON-1612724277 None] Acquiring lock "cinder-quobyte-6315281d-99ba-453c-ac0a-c2756f0bb842" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5ed9e755-dced-421b-8746-f410e24d933c tempest-VolumeQuotasAdminTestJSON-1612724277 None] Lock "cinder-quobyte-6315281d-99ba-453c-ac0a-c2756f0bb842" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:06 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2251f6-dcb7-499d-8e86-286a3c906ff2]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:09:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5ed9e755-dced-421b-8746-f410e24d933c tempest-VolumeQuotasAdminTestJSON-1612724277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6315281d-99ba-453c-ac0a-c2756f0bb842 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:06 devstack sudo[94926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6315281d-99ba-453c-ac0a-c2756f0bb842
Nov 05 15:09:06 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:06 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5ed9e755-dced-421b-8746-f410e24d933c tempest-VolumeQuotasAdminTestJSON-1612724277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6315281d-99ba-453c-ac0a-c2756f0bb842" returned: 0 in 0.679s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5ed9e755-dced-421b-8746-f410e24d933c tempest-VolumeQuotasAdminTestJSON-1612724277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6315281d-99ba-453c-ac0a-c2756f0bb842 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:06 devstack sudo[94962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6315281d-99ba-453c-ac0a-c2756f0bb842
Nov 05 15:09:06 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:07 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5ed9e755-dced-421b-8746-f410e24d933c tempest-VolumeQuotasAdminTestJSON-1612724277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6315281d-99ba-453c-ac0a-c2756f0bb842" returned: 0 in 0.420s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5ed9e755-dced-421b-8746-f410e24d933c tempest-VolumeQuotasAdminTestJSON-1612724277 None] Lock "cinder-quobyte-6315281d-99ba-453c-ac0a-c2756f0bb842" released by "delete_volume" :: held 1.200s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:07 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-5ed9e755-dced-421b-8746-f410e24d933c tempest-VolumeQuotasAdminTestJSON-1612724277 None] Created reservations ['7babfcbf-e2e7-4fed-b5d1-327d77786ef6', '84297a07-6f38-4be8-b12c-0fc7db79473b', '92b9537b-fa74-456e-b5e9-16c52419e4c9', 'a20680a4-1324-4411-a8d9-b7aab35d9a08'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:09:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5ed9e755-dced-421b-8746-f410e24d933c tempest-VolumeQuotasAdminTestJSON-1612724277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5ed9e755-dced-421b-8746-f410e24d933c tempest-VolumeQuotasAdminTestJSON-1612724277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5ed9e755-dced-421b-8746-f410e24d933c tempest-VolumeQuotasAdminTestJSON-1612724277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:09:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5ed9e755-dced-421b-8746-f410e24d933c tempest-VolumeQuotasAdminTestJSON-1612724277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:09:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5ed9e755-dced-421b-8746-f410e24d933c tempest-VolumeQuotasAdminTestJSON-1612724277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5ed9e755-dced-421b-8746-f410e24d933c tempest-VolumeQuotasAdminTestJSON-1612724277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:07 devstack sudo[94976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:09:07 devstack sudo[94976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:07 devstack sudo[94976]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5ed9e755-dced-421b-8746-f410e24d933c tempest-VolumeQuotasAdminTestJSON-1612724277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.395s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:07 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-5ed9e755-dced-421b-8746-f410e24d933c tempest-VolumeQuotasAdminTestJSON-1612724277 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:09:07 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5ed9e755-dced-421b-8746-f410e24d933c tempest-VolumeQuotasAdminTestJSON-1612724277 None] Deleted volume successfully.
Nov 05 15:09:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5ed9e755-dced-421b-8746-f410e24d933c tempest-VolumeQuotasAdminTestJSON-1612724277 None] Lock "cinder-6315281d-99ba-453c-ac0a-c2756f0bb842-delete_volume" released by "delete_volume" :: held 2.061s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:08 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-25574841-6563-43ae-b9b4-0350cf0382f8 req-fa23e4aa-774f-4907-83be-05727d9197f5 tempest-AttachVolumeNegativeTest-1140258724 None] Terminate volume connection completed successfully.
Nov 05 15:09:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-25574841-6563-43ae-b9b4-0350cf0382f8 req-fa23e4aa-774f-4907-83be-05727d9197f5 tempest-AttachVolumeNegativeTest-1140258724 None] Deleting attachment 4f5f9e72-4f1c-494d-95e4-ae4f0a37b96f. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 15:09:09 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:09:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Flow 'volume_create_manager' (5fb5263a-7e71-408d-9c6b-b614d15eff53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:09:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3361e347-234a-4896-98b3-22912642544a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3361e347-234a-4896-98b3-22912642544a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-17580976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d29d6541-209c-4de4-b397-c24c8ca4c76e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126e1ef06bd44a2b8fc2e5eb67181bd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:09Z,use_quota=True,user_id='c82b7d803e8f4a919ceb798d59575fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0eb7e3-eb94-4b34-b58d-835c89d1489c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0eb7e3-eb94-4b34-b58d-835c89d1489c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508c5a08-cac8-4334-b1a5-0cf85a1cba46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508c5a08-cac8-4334-b1a5-0cf85a1cba46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd29d6541-209c-4de4-b397-c24c8ca4c76e', 'volume_name': 'volume-d29d6541-209c-4de4-b397-c24c8ca4c76e', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb4ea9d-bbfa-4c9b-929c-769378bb19e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb4ea9d-bbfa-4c9b-929c-769378bb19e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3aa334-319e-41be-beb1-31bedae3c918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:09 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Volume d29d6541-209c-4de4-b397-c24c8ca4c76e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d29d6541-209c-4de4-b397-c24c8ca4c76e', 'volume_size': 1}
Nov 05 15:09:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-17580976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d29d6541-209c-4de4-b397-c24c8ca4c76e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126e1ef06bd44a2b8fc2e5eb67181bd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:09Z,use_quota=True,user_id='c82b7d803e8f4a919ceb798d59575fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:09:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Creating volume d29d6541-209c-4de4-b397-c24c8ca4c76e {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:09:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:09:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:09:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:09:09 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:09:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d29d6541-209c-4de4-b397-c24c8ca4c76e 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:09 devstack sudo[95011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d29d6541-209c-4de4-b397-c24c8ca4c76e 1073741824
Nov 05 15:09:09 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:10 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d29d6541-209c-4de4-b397-c24c8ca4c76e 1073741824" returned: 0 in 0.827s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d29d6541-209c-4de4-b397-c24c8ca4c76e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:10 devstack sudo[95019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d29d6541-209c-4de4-b397-c24c8ca4c76e
Nov 05 15:09:10 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:10 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d29d6541-209c-4de4-b397-c24c8ca4c76e" returned: 0 in 0.617s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:09:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3aa334-319e-41be-beb1-31bedae3c918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d29d6541-209c-4de4-b397-c24c8ca4c76e', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81685884-d300-4616-a6cd-66e843e62bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:10 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Volume volume-d29d6541-209c-4de4-b397-c24c8ca4c76e (d29d6541-209c-4de4-b397-c24c8ca4c76e): created successfully
Nov 05 15:09:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81685884-d300-4616-a6cd-66e843e62bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Flow 'volume_create_manager' (5fb5263a-7e71-408d-9c6b-b614d15eff53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:09:11 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-df45e5a0-3ceb-46a3-bebd-9e238004fcbd tempest-VolumeQuotasAdminTestJSON-1612724277 None] Created volume successfully.
Nov 05 15:09:11 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:09:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Flow 'volume_create_manager' (7da98ce4-f3f0-4023-abf7-b2bdb03786a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:09:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d575cf9-4cb8-4694-b8de-b586cc376fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d575cf9-4cb8-4694-b8de-b586cc376fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-330491074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cbcdc86-5a34-4710-b6bd-c9474d307806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d7dad6d2c04a6ca1689b82eaad697d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:11Z,use_quota=True,user_id='7f9fb02678a54596b3f88ac83e456534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c74ea62-a20e-4f0e-9728-54e6af08c6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c74ea62-a20e-4f0e-9728-54e6af08c6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e618a176-5267-447d-b163-364c2df74550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e618a176-5267-447d-b163-364c2df74550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cbcdc86-5a34-4710-b6bd-c9474d307806', 'volume_name': 'volume-1cbcdc86-5a34-4710-b6bd-c9474d307806', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac35a6e9-8e95-4736-bd8c-5319d76183f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac35a6e9-8e95-4736-bd8c-5319d76183f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a7d03e-4140-4518-a8e0-bc91735e607f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:11 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Volume 1cbcdc86-5a34-4710-b6bd-c9474d307806: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cbcdc86-5a34-4710-b6bd-c9474d307806', 'volume_size': 1}
Nov 05 15:09:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-330491074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cbcdc86-5a34-4710-b6bd-c9474d307806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d7dad6d2c04a6ca1689b82eaad697d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:11Z,use_quota=True,user_id='7f9fb02678a54596b3f88ac83e456534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:09:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Creating volume 1cbcdc86-5a34-4710-b6bd-c9474d307806 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:09:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:09:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:09:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:09:11 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:09:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:11 devstack sudo[95085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806 1073741824
Nov 05 15:09:11 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:12 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806 1073741824" returned: 0 in 0.953s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:12 devstack sudo[95113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806
Nov 05 15:09:12 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:13 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9ffb1247-b251-422f-8eba-e0640169fffe tempest-VolumeQuotasAdminTestJSON-1132791313 None] Transfer volume completed successfully.
Nov 05 15:09:13 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806" returned: 0 in 0.774s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:09:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a7d03e-4140-4518-a8e0-bc91735e607f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cbcdc86-5a34-4710-b6bd-c9474d307806', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c5126e-5e90-42fe-bf30-8dfb11bd1a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:13 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Volume volume-1cbcdc86-5a34-4710-b6bd-c9474d307806 (1cbcdc86-5a34-4710-b6bd-c9474d307806): created successfully
Nov 05 15:09:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c5126e-5e90-42fe-bf30-8dfb11bd1a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Flow 'volume_create_manager' (7da98ce4-f3f0-4023-abf7-b2bdb03786a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:09:13 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a70d9bdc-ab20-443c-a929-65a1f8878bd6 tempest-SnapshotMetadataTestJSON-228891847 None] Created volume successfully.
Nov 05 15:09:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d50901b8-e836-4878-8244-e610f493ee0f tempest-VolumeQuotasAdminTestJSON-1000583481 None] Acquiring lock "cinder-d29d6541-209c-4de4-b397-c24c8ca4c76e-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d50901b8-e836-4878-8244-e610f493ee0f tempest-VolumeQuotasAdminTestJSON-1000583481 None] Lock "cinder-d29d6541-209c-4de4-b397-c24c8ca4c76e-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d50901b8-e836-4878-8244-e610f493ee0f tempest-VolumeQuotasAdminTestJSON-1000583481 None] Acquiring lock "cinder-quobyte-d29d6541-209c-4de4-b397-c24c8ca4c76e" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d50901b8-e836-4878-8244-e610f493ee0f tempest-VolumeQuotasAdminTestJSON-1000583481 None] Lock "cinder-quobyte-d29d6541-209c-4de4-b397-c24c8ca4c76e" acquired by "delete_volume" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:14 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f6e6d8-9b11-474f-bead-6eb604916956]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:09:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d50901b8-e836-4878-8244-e610f493ee0f tempest-VolumeQuotasAdminTestJSON-1000583481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d29d6541-209c-4de4-b397-c24c8ca4c76e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:14 devstack sudo[95119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d29d6541-209c-4de4-b397-c24c8ca4c76e
Nov 05 15:09:14 devstack sudo[95119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-418c434c-da88-4735-a93c-8de80fa362c9 tempest-SnapshotMetadataTestJSON-228891847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-418c434c-da88-4735-a93c-8de80fa362c9 tempest-SnapshotMetadataTestJSON-228891847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-418c434c-da88-4735-a93c-8de80fa362c9 tempest-SnapshotMetadataTestJSON-228891847 None] Creating offline snapshot 02a14a0a-a366-4c0e-a60a-364ed4a11c7f of volume 1cbcdc86-5a34-4710-b6bd-c9474d307806 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:09:14 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2984fe7-5c83-452e-af68-e0cb2492aee8]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:09:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-418c434c-da88-4735-a93c-8de80fa362c9 tempest-SnapshotMetadataTestJSON-228891847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:14 devstack sudo[95156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806
Nov 05 15:09:14 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:14 devstack sudo[95119]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d50901b8-e836-4878-8244-e610f493ee0f tempest-VolumeQuotasAdminTestJSON-1000583481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d29d6541-209c-4de4-b397-c24c8ca4c76e" returned: 0 in 0.656s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d50901b8-e836-4878-8244-e610f493ee0f tempest-VolumeQuotasAdminTestJSON-1000583481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d29d6541-209c-4de4-b397-c24c8ca4c76e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:14 devstack sudo[95162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d29d6541-209c-4de4-b397-c24c8ca4c76e
Nov 05 15:09:14 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:15 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-418c434c-da88-4735-a93c-8de80fa362c9 tempest-SnapshotMetadataTestJSON-228891847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806" returned: 0 in 0.554s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-418c434c-da88-4735-a93c-8de80fa362c9 tempest-SnapshotMetadataTestJSON-228891847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.02a14a0a-a366-4c0e-a60a-364ed4a11c7f 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:15 devstack sudo[95168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.02a14a0a-a366-4c0e-a60a-364ed4a11c7f 1G
Nov 05 15:09:15 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:15 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d50901b8-e836-4878-8244-e610f493ee0f tempest-VolumeQuotasAdminTestJSON-1000583481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d29d6541-209c-4de4-b397-c24c8ca4c76e" returned: 0 in 0.496s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d50901b8-e836-4878-8244-e610f493ee0f tempest-VolumeQuotasAdminTestJSON-1000583481 None] Lock "cinder-quobyte-d29d6541-209c-4de4-b397-c24c8ca4c76e" released by "delete_volume" :: held 1.279s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:15 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-d50901b8-e836-4878-8244-e610f493ee0f tempest-VolumeQuotasAdminTestJSON-1000583481 None] Created reservations ['9def3007-63ab-48e8-9d93-409846794377', 'b1878343-7f31-4d8c-b97d-4049c0668e79', 'e1102483-bc17-4795-9eba-641fc5a230d4', 'b03a3c01-e9c9-48c6-9c63-cc543f1a7187'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:09:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d50901b8-e836-4878-8244-e610f493ee0f tempest-VolumeQuotasAdminTestJSON-1000583481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d50901b8-e836-4878-8244-e610f493ee0f tempest-VolumeQuotasAdminTestJSON-1000583481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d50901b8-e836-4878-8244-e610f493ee0f tempest-VolumeQuotasAdminTestJSON-1000583481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:09:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d50901b8-e836-4878-8244-e610f493ee0f tempest-VolumeQuotasAdminTestJSON-1000583481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:09:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d50901b8-e836-4878-8244-e610f493ee0f tempest-VolumeQuotasAdminTestJSON-1000583481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d50901b8-e836-4878-8244-e610f493ee0f tempest-VolumeQuotasAdminTestJSON-1000583481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:15 devstack sudo[95176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:09:15 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:15 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-418c434c-da88-4735-a93c-8de80fa362c9 tempest-SnapshotMetadataTestJSON-228891847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.02a14a0a-a366-4c0e-a60a-364ed4a11c7f 1G" returned: 0 in 0.835s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-418c434c-da88-4735-a93c-8de80fa362c9 tempest-SnapshotMetadataTestJSON-228891847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cbcdc86-5a34-4710-b6bd-c9474d307806 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.02a14a0a-a366-4c0e-a60a-364ed4a11c7f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:16 devstack sudo[95178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cbcdc86-5a34-4710-b6bd-c9474d307806 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.02a14a0a-a366-4c0e-a60a-364ed4a11c7f
Nov 05 15:09:16 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:16 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d50901b8-e836-4878-8244-e610f493ee0f tempest-VolumeQuotasAdminTestJSON-1000583481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.561s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:16 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-d50901b8-e836-4878-8244-e610f493ee0f tempest-VolumeQuotasAdminTestJSON-1000583481 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:09:16 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d50901b8-e836-4878-8244-e610f493ee0f tempest-VolumeQuotasAdminTestJSON-1000583481 None] Deleted volume successfully.
Nov 05 15:09:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d50901b8-e836-4878-8244-e610f493ee0f tempest-VolumeQuotasAdminTestJSON-1000583481 None] Lock "cinder-d29d6541-209c-4de4-b397-c24c8ca4c76e-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:16 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-418c434c-da88-4735-a93c-8de80fa362c9 tempest-SnapshotMetadataTestJSON-228891847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cbcdc86-5a34-4710-b6bd-c9474d307806 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.02a14a0a-a366-4c0e-a60a-364ed4a11c7f" returned: 0 in 0.587s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:16 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-418c434c-da88-4735-a93c-8de80fa362c9 tempest-SnapshotMetadataTestJSON-228891847 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.02a14a0a-a366-4c0e-a60a-364ed4a11c7f is being set with open permissions: ugo+rw
Nov 05 15:09:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-418c434c-da88-4735-a93c-8de80fa362c9 tempest-SnapshotMetadataTestJSON-228891847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.02a14a0a-a366-4c0e-a60a-364ed4a11c7f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:16 devstack sudo[95185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.02a14a0a-a366-4c0e-a60a-364ed4a11c7f
Nov 05 15:09:16 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:17 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-418c434c-da88-4735-a93c-8de80fa362c9 tempest-SnapshotMetadataTestJSON-228891847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.02a14a0a-a366-4c0e-a60a-364ed4a11c7f" returned: 0 in 0.441s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-418c434c-da88-4735-a93c-8de80fa362c9 tempest-SnapshotMetadataTestJSON-228891847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:17 devstack sudo[95188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.info
Nov 05 15:09:17 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:17 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-418c434c-da88-4735-a93c-8de80fa362c9 tempest-SnapshotMetadataTestJSON-228891847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.info" returned: 0 in 0.463s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:17 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-418c434c-da88-4735-a93c-8de80fa362c9 tempest-SnapshotMetadataTestJSON-228891847 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.info is being set with open permissions: ugo+rw
Nov 05 15:09:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-418c434c-da88-4735-a93c-8de80fa362c9 tempest-SnapshotMetadataTestJSON-228891847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:17 devstack sudo[95194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.info
Nov 05 15:09:17 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:17 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-418c434c-da88-4735-a93c-8de80fa362c9 tempest-SnapshotMetadataTestJSON-228891847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.info" returned: 0 in 0.410s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-418c434c-da88-4735-a93c-8de80fa362c9 tempest-SnapshotMetadataTestJSON-228891847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.488s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-418c434c-da88-4735-a93c-8de80fa362c9 tempest-SnapshotMetadataTestJSON-228891847 None] Create snapshot completed successfully
Nov 05 15:09:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-636eb5c1-382f-47c6-8b29-70af2365e05e tempest-AttachVolumeNegativeTest-1140258724 None] Acquiring lock "cinder-c9559fed-0cc3-4182-abb9-8d24103d1bad-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-636eb5c1-382f-47c6-8b29-70af2365e05e tempest-AttachVolumeNegativeTest-1140258724 None] Lock "cinder-c9559fed-0cc3-4182-abb9-8d24103d1bad-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-636eb5c1-382f-47c6-8b29-70af2365e05e tempest-AttachVolumeNegativeTest-1140258724 None] Acquiring lock "cinder-quobyte-c9559fed-0cc3-4182-abb9-8d24103d1bad" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-636eb5c1-382f-47c6-8b29-70af2365e05e tempest-AttachVolumeNegativeTest-1140258724 None] Lock "cinder-quobyte-c9559fed-0cc3-4182-abb9-8d24103d1bad" acquired by "delete_volume" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:19 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[578df6b0-f8f3-4dac-b4f3-9e442681a82f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:09:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-636eb5c1-382f-47c6-8b29-70af2365e05e tempest-AttachVolumeNegativeTest-1140258724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c9559fed-0cc3-4182-abb9-8d24103d1bad {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:19 devstack sudo[95199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c9559fed-0cc3-4182-abb9-8d24103d1bad
Nov 05 15:09:19 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:19 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-636eb5c1-382f-47c6-8b29-70af2365e05e tempest-AttachVolumeNegativeTest-1140258724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c9559fed-0cc3-4182-abb9-8d24103d1bad" returned: 0 in 0.559s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-636eb5c1-382f-47c6-8b29-70af2365e05e tempest-AttachVolumeNegativeTest-1140258724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c9559fed-0cc3-4182-abb9-8d24103d1bad {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:19 devstack sudo[95204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c9559fed-0cc3-4182-abb9-8d24103d1bad
Nov 05 15:09:19 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:20 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-636eb5c1-382f-47c6-8b29-70af2365e05e tempest-AttachVolumeNegativeTest-1140258724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c9559fed-0cc3-4182-abb9-8d24103d1bad" returned: 0 in 0.314s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-636eb5c1-382f-47c6-8b29-70af2365e05e tempest-AttachVolumeNegativeTest-1140258724 None] Lock "cinder-quobyte-c9559fed-0cc3-4182-abb9-8d24103d1bad" released by "delete_volume" :: held 0.947s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-636eb5c1-382f-47c6-8b29-70af2365e05e tempest-AttachVolumeNegativeTest-1140258724 None] Created reservations ['2d790c54-3625-4245-a794-dc5742627114', '26b3824f-a41b-4a71-b4c9-cbdc88e7c28d', '89c67e94-4bec-4147-8269-9c9ac32dca76', '847b0ae9-9420-419d-936e-9adccca9901a'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-46676592-c5d2-456e-b6f9-55eba10f0731 tempest-SnapshotMetadataTestJSON-228891847 None] Acquiring lock "cinder-02a14a0a-a366-4c0e-a60a-364ed4a11c7f-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-636eb5c1-382f-47c6-8b29-70af2365e05e tempest-AttachVolumeNegativeTest-1140258724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-636eb5c1-382f-47c6-8b29-70af2365e05e tempest-AttachVolumeNegativeTest-1140258724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-636eb5c1-382f-47c6-8b29-70af2365e05e tempest-AttachVolumeNegativeTest-1140258724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-636eb5c1-382f-47c6-8b29-70af2365e05e tempest-AttachVolumeNegativeTest-1140258724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-636eb5c1-382f-47c6-8b29-70af2365e05e tempest-AttachVolumeNegativeTest-1140258724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-636eb5c1-382f-47c6-8b29-70af2365e05e tempest-AttachVolumeNegativeTest-1140258724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-46676592-c5d2-456e-b6f9-55eba10f0731 tempest-SnapshotMetadataTestJSON-228891847 None] Lock "cinder-02a14a0a-a366-4c0e-a60a-364ed4a11c7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.089s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-46676592-c5d2-456e-b6f9-55eba10f0731 tempest-SnapshotMetadataTestJSON-228891847 None] Acquiring lock "cinder-quobyte-1cbcdc86-5a34-4710-b6bd-c9474d307806" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-46676592-c5d2-456e-b6f9-55eba10f0731 tempest-SnapshotMetadataTestJSON-228891847 None] Lock "cinder-quobyte-1cbcdc86-5a34-4710-b6bd-c9474d307806" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-46676592-c5d2-456e-b6f9-55eba10f0731 tempest-SnapshotMetadataTestJSON-228891847 None] Acquiring lock "cinder-quobyte-02a14a0a-a366-4c0e-a60a-364ed4a11c7f" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:20 devstack sudo[95213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:09:20 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-46676592-c5d2-456e-b6f9-55eba10f0731 tempest-SnapshotMetadataTestJSON-228891847 None] Lock "cinder-quobyte-02a14a0a-a366-4c0e-a60a-364ed4a11c7f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-46676592-c5d2-456e-b6f9-55eba10f0731 tempest-SnapshotMetadataTestJSON-228891847 None] Deleting offline snapshot 02a14a0a-a366-4c0e-a60a-364ed4a11c7f of volume 1cbcdc86-5a34-4710-b6bd-c9474d307806 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-46676592-c5d2-456e-b6f9-55eba10f0731 tempest-SnapshotMetadataTestJSON-228891847 None] snapshot_file for this snap is: volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.02a14a0a-a366-4c0e-a60a-364ed4a11c7f {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f9ca45-2b9d-4fb4-89af-f2ca5694ceb2]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-46676592-c5d2-456e-b6f9-55eba10f0731 tempest-SnapshotMetadataTestJSON-228891847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.02a14a0a-a366-4c0e-a60a-364ed4a11c7f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-65a54e93-7655-430d-be99-b20924899911 tempest-AttachVolumeNegativeTest-1140258724 None] Acquiring lock "cinder-9aa17a56-1d11-478c-869c-6fb380dfe694-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-65a54e93-7655-430d-be99-b20924899911 tempest-AttachVolumeNegativeTest-1140258724 None] Lock "cinder-9aa17a56-1d11-478c-869c-6fb380dfe694-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:20 devstack sudo[95215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.02a14a0a-a366-4c0e-a60a-364ed4a11c7f
Nov 05 15:09:20 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-65a54e93-7655-430d-be99-b20924899911 tempest-AttachVolumeNegativeTest-1140258724 None] Acquiring lock "cinder-quobyte-9aa17a56-1d11-478c-869c-6fb380dfe694" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-65a54e93-7655-430d-be99-b20924899911 tempest-AttachVolumeNegativeTest-1140258724 None] Lock "cinder-quobyte-9aa17a56-1d11-478c-869c-6fb380dfe694" acquired by "delete_volume" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1722e0-a084-45f1-b766-c0dab8d29005]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:09:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-65a54e93-7655-430d-be99-b20924899911 tempest-AttachVolumeNegativeTest-1140258724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9aa17a56-1d11-478c-869c-6fb380dfe694 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:21 devstack sudo[95217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9aa17a56-1d11-478c-869c-6fb380dfe694
Nov 05 15:09:21 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:21 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-636eb5c1-382f-47c6-8b29-70af2365e05e tempest-AttachVolumeNegativeTest-1140258724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.672s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:21 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-636eb5c1-382f-47c6-8b29-70af2365e05e tempest-AttachVolumeNegativeTest-1140258724 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:09:21 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-636eb5c1-382f-47c6-8b29-70af2365e05e tempest-AttachVolumeNegativeTest-1140258724 None] Deleted volume successfully.
Nov 05 15:09:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-636eb5c1-382f-47c6-8b29-70af2365e05e tempest-AttachVolumeNegativeTest-1140258724 None] Lock "cinder-c9559fed-0cc3-4182-abb9-8d24103d1bad-delete_volume" released by "delete_volume" :: held 2.002s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:21 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-46676592-c5d2-456e-b6f9-55eba10f0731 tempest-SnapshotMetadataTestJSON-228891847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.02a14a0a-a366-4c0e-a60a-364ed4a11c7f" returned: 0 in 0.624s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-46676592-c5d2-456e-b6f9-55eba10f0731 tempest-SnapshotMetadataTestJSON-228891847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cbcdc86-5a34-4710-b6bd-c9474d307806(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:09:21 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2315b972-f23a-4202-9700-a5ee0012ed66]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:09:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-46676592-c5d2-456e-b6f9-55eba10f0731 tempest-SnapshotMetadataTestJSON-228891847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:21 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-65a54e93-7655-430d-be99-b20924899911 tempest-AttachVolumeNegativeTest-1140258724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9aa17a56-1d11-478c-869c-6fb380dfe694" returned: 0 in 0.534s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-65a54e93-7655-430d-be99-b20924899911 tempest-AttachVolumeNegativeTest-1140258724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9aa17a56-1d11-478c-869c-6fb380dfe694 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:21 devstack sudo[95228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9aa17a56-1d11-478c-869c-6fb380dfe694
Nov 05 15:09:21 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:21 devstack sudo[95226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806
Nov 05 15:09:21 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:21 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-65a54e93-7655-430d-be99-b20924899911 tempest-AttachVolumeNegativeTest-1140258724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9aa17a56-1d11-478c-869c-6fb380dfe694" returned: 0 in 0.296s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-65a54e93-7655-430d-be99-b20924899911 tempest-AttachVolumeNegativeTest-1140258724 None] Lock "cinder-quobyte-9aa17a56-1d11-478c-869c-6fb380dfe694" released by "delete_volume" :: held 0.933s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:21 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:21 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-65a54e93-7655-430d-be99-b20924899911 tempest-AttachVolumeNegativeTest-1140258724 None] Created reservations ['65d655c3-dcee-4770-ac53-5806fabb4ea4', '2857b123-acb1-4b50-9219-7b8c6aed5b18', 'a7dae742-b0b0-474e-9e24-a76d63e146e2', '1bcaaae0-c561-4f3f-8d89-f50c5c185415'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:09:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-46676592-c5d2-456e-b6f9-55eba10f0731 tempest-SnapshotMetadataTestJSON-228891847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806" returned: 0 in 0.527s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-46676592-c5d2-456e-b6f9-55eba10f0731 tempest-SnapshotMetadataTestJSON-228891847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.02a14a0a-a366-4c0e-a60a-364ed4a11c7f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:21 devstack sudo[95236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.02a14a0a-a366-4c0e-a60a-364ed4a11c7f
Nov 05 15:09:21 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-65a54e93-7655-430d-be99-b20924899911 tempest-AttachVolumeNegativeTest-1140258724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-65a54e93-7655-430d-be99-b20924899911 tempest-AttachVolumeNegativeTest-1140258724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-65a54e93-7655-430d-be99-b20924899911 tempest-AttachVolumeNegativeTest-1140258724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:09:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-65a54e93-7655-430d-be99-b20924899911 tempest-AttachVolumeNegativeTest-1140258724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:09:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-65a54e93-7655-430d-be99-b20924899911 tempest-AttachVolumeNegativeTest-1140258724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-65a54e93-7655-430d-be99-b20924899911 tempest-AttachVolumeNegativeTest-1140258724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:22 devstack sudo[95238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:09:22 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:22 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-46676592-c5d2-456e-b6f9-55eba10f0731 tempest-SnapshotMetadataTestJSON-228891847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.02a14a0a-a366-4c0e-a60a-364ed4a11c7f" returned: 0 in 0.600s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-46676592-c5d2-456e-b6f9-55eba10f0731 tempest-SnapshotMetadataTestJSON-228891847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.02a14a0a-a366-4c0e-a60a-364ed4a11c7f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-616f3f3f-d8c3-4271-a896-569d2dd82f5b tempest-AttachVolumeNegativeTest-1140258724 None] Acquiring lock "cinder-ba98973d-c84d-435d-a931-98465d145ede-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-616f3f3f-d8c3-4271-a896-569d2dd82f5b tempest-AttachVolumeNegativeTest-1140258724 None] Lock "cinder-ba98973d-c84d-435d-a931-98465d145ede-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:22 devstack sudo[95243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.02a14a0a-a366-4c0e-a60a-364ed4a11c7f
Nov 05 15:09:22 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-616f3f3f-d8c3-4271-a896-569d2dd82f5b tempest-AttachVolumeNegativeTest-1140258724 None] Acquiring lock "cinder-quobyte-ba98973d-c84d-435d-a931-98465d145ede" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-616f3f3f-d8c3-4271-a896-569d2dd82f5b tempest-AttachVolumeNegativeTest-1140258724 None] Lock "cinder-quobyte-ba98973d-c84d-435d-a931-98465d145ede" acquired by "delete_volume" :: waited 0.036s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:22 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-65a54e93-7655-430d-be99-b20924899911 tempest-AttachVolumeNegativeTest-1140258724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.630s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:22 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-65a54e93-7655-430d-be99-b20924899911 tempest-AttachVolumeNegativeTest-1140258724 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:09:22 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-65a54e93-7655-430d-be99-b20924899911 tempest-AttachVolumeNegativeTest-1140258724 None] Deleted volume successfully.
Nov 05 15:09:22 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad11a98-8153-4750-9145-4264766c1ca5]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:09:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-616f3f3f-d8c3-4271-a896-569d2dd82f5b tempest-AttachVolumeNegativeTest-1140258724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ba98973d-c84d-435d-a931-98465d145ede {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-65a54e93-7655-430d-be99-b20924899911 tempest-AttachVolumeNegativeTest-1140258724 None] Lock "cinder-9aa17a56-1d11-478c-869c-6fb380dfe694-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:22 devstack sudo[95246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ba98973d-c84d-435d-a931-98465d145ede
Nov 05 15:09:22 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:22 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-46676592-c5d2-456e-b6f9-55eba10f0731 tempest-SnapshotMetadataTestJSON-228891847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806.02a14a0a-a366-4c0e-a60a-364ed4a11c7f" returned: 0 in 0.466s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-46676592-c5d2-456e-b6f9-55eba10f0731 tempest-SnapshotMetadataTestJSON-228891847 None] Lock "cinder-quobyte-02a14a0a-a366-4c0e-a60a-364ed4a11c7f" released by "_delete_snapshot" :: held 2.440s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-46676592-c5d2-456e-b6f9-55eba10f0731 tempest-SnapshotMetadataTestJSON-228891847 None] Lock "cinder-quobyte-1cbcdc86-5a34-4710-b6bd-c9474d307806" released by "delete_snapshot" :: held 2.484s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:23 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-46676592-c5d2-456e-b6f9-55eba10f0731 tempest-SnapshotMetadataTestJSON-228891847 None] Created reservations ['df4753d3-79e5-4342-95f3-ea1edc7acb2f', 'a67579c1-fec0-402c-b2a1-d3972e75fbc0', 'fabb0071-8e65-404a-952b-0dd603a81dd1', '3836375a-cd78-4788-a73c-35f68cd842c7'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:09:23 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-46676592-c5d2-456e-b6f9-55eba10f0731 tempest-SnapshotMetadataTestJSON-228891847 None] Delete snapshot completed successfully.
Nov 05 15:09:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-46676592-c5d2-456e-b6f9-55eba10f0731 tempest-SnapshotMetadataTestJSON-228891847 None] Lock "cinder-02a14a0a-a366-4c0e-a60a-364ed4a11c7f-delete_snapshot" released by "delete_snapshot" :: held 2.722s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:23 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-616f3f3f-d8c3-4271-a896-569d2dd82f5b tempest-AttachVolumeNegativeTest-1140258724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ba98973d-c84d-435d-a931-98465d145ede" returned: 0 in 0.580s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-616f3f3f-d8c3-4271-a896-569d2dd82f5b tempest-AttachVolumeNegativeTest-1140258724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ba98973d-c84d-435d-a931-98465d145ede {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:23 devstack sudo[95252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ba98973d-c84d-435d-a931-98465d145ede
Nov 05 15:09:23 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:23 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-616f3f3f-d8c3-4271-a896-569d2dd82f5b tempest-AttachVolumeNegativeTest-1140258724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ba98973d-c84d-435d-a931-98465d145ede" returned: 0 in 0.297s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-616f3f3f-d8c3-4271-a896-569d2dd82f5b tempest-AttachVolumeNegativeTest-1140258724 None] Lock "cinder-quobyte-ba98973d-c84d-435d-a931-98465d145ede" released by "delete_volume" :: held 0.974s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:23 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-616f3f3f-d8c3-4271-a896-569d2dd82f5b tempest-AttachVolumeNegativeTest-1140258724 None] Created reservations ['ad876cce-3714-4a3d-8d00-19a4ebb49224', 'c8f411d0-6984-417e-9086-fdd3914d020f', '5b0988e3-ae07-42e8-818a-a92670405817', 'eaecf4f8-f9e9-4fef-8241-ae199255d20c'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:09:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-616f3f3f-d8c3-4271-a896-569d2dd82f5b tempest-AttachVolumeNegativeTest-1140258724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-616f3f3f-d8c3-4271-a896-569d2dd82f5b tempest-AttachVolumeNegativeTest-1140258724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-616f3f3f-d8c3-4271-a896-569d2dd82f5b tempest-AttachVolumeNegativeTest-1140258724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:09:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-616f3f3f-d8c3-4271-a896-569d2dd82f5b tempest-AttachVolumeNegativeTest-1140258724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:09:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-616f3f3f-d8c3-4271-a896-569d2dd82f5b tempest-AttachVolumeNegativeTest-1140258724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-616f3f3f-d8c3-4271-a896-569d2dd82f5b tempest-AttachVolumeNegativeTest-1140258724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:23 devstack sudo[95255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:09:23 devstack sudo[95255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3edc259f-5f9d-4a01-b023-ab102fe3f24d tempest-SnapshotMetadataTestJSON-228891847 None] Acquiring lock "cinder-1cbcdc86-5a34-4710-b6bd-c9474d307806-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3edc259f-5f9d-4a01-b023-ab102fe3f24d tempest-SnapshotMetadataTestJSON-228891847 None] Lock "cinder-1cbcdc86-5a34-4710-b6bd-c9474d307806-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3edc259f-5f9d-4a01-b023-ab102fe3f24d tempest-SnapshotMetadataTestJSON-228891847 None] Acquiring lock "cinder-quobyte-1cbcdc86-5a34-4710-b6bd-c9474d307806" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3edc259f-5f9d-4a01-b023-ab102fe3f24d tempest-SnapshotMetadataTestJSON-228891847 None] Lock "cinder-quobyte-1cbcdc86-5a34-4710-b6bd-c9474d307806" acquired by "delete_volume" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:24 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[055866ae-dc92-4243-9f55-2f5ecb7118bf]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:09:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3edc259f-5f9d-4a01-b023-ab102fe3f24d tempest-SnapshotMetadataTestJSON-228891847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:24 devstack sudo[95255]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-616f3f3f-d8c3-4271-a896-569d2dd82f5b tempest-AttachVolumeNegativeTest-1140258724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.341s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:24 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-616f3f3f-d8c3-4271-a896-569d2dd82f5b tempest-AttachVolumeNegativeTest-1140258724 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:09:24 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-616f3f3f-d8c3-4271-a896-569d2dd82f5b tempest-AttachVolumeNegativeTest-1140258724 None] Deleted volume successfully.
Nov 05 15:09:24 devstack sudo[95257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806
Nov 05 15:09:24 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-616f3f3f-d8c3-4271-a896-569d2dd82f5b tempest-AttachVolumeNegativeTest-1140258724 None] Lock "cinder-ba98973d-c84d-435d-a931-98465d145ede-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:24 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3edc259f-5f9d-4a01-b023-ab102fe3f24d tempest-SnapshotMetadataTestJSON-228891847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806" returned: 0 in 0.424s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3edc259f-5f9d-4a01-b023-ab102fe3f24d tempest-SnapshotMetadataTestJSON-228891847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:24 devstack sudo[95263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806
Nov 05 15:09:24 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:24 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3edc259f-5f9d-4a01-b023-ab102fe3f24d tempest-SnapshotMetadataTestJSON-228891847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1cbcdc86-5a34-4710-b6bd-c9474d307806" returned: 0 in 0.276s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3edc259f-5f9d-4a01-b023-ab102fe3f24d tempest-SnapshotMetadataTestJSON-228891847 None] Lock "cinder-quobyte-1cbcdc86-5a34-4710-b6bd-c9474d307806" released by "delete_volume" :: held 0.785s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:24 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-3edc259f-5f9d-4a01-b023-ab102fe3f24d tempest-SnapshotMetadataTestJSON-228891847 None] Created reservations ['38085532-6fdb-4d27-963a-a28f281a8de3', 'ba687707-270e-495e-88b3-35a9fd397354', '857ba163-e5eb-4d11-be36-88084e5cc56f', 'e0b0a012-7be8-4d8b-9077-10bdbda01da9'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:09:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3edc259f-5f9d-4a01-b023-ab102fe3f24d tempest-SnapshotMetadataTestJSON-228891847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3edc259f-5f9d-4a01-b023-ab102fe3f24d tempest-SnapshotMetadataTestJSON-228891847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3edc259f-5f9d-4a01-b023-ab102fe3f24d tempest-SnapshotMetadataTestJSON-228891847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:09:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3edc259f-5f9d-4a01-b023-ab102fe3f24d tempest-SnapshotMetadataTestJSON-228891847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:09:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3edc259f-5f9d-4a01-b023-ab102fe3f24d tempest-SnapshotMetadataTestJSON-228891847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3edc259f-5f9d-4a01-b023-ab102fe3f24d tempest-SnapshotMetadataTestJSON-228891847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:24 devstack sudo[95266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:09:24 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:25 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3edc259f-5f9d-4a01-b023-ab102fe3f24d tempest-SnapshotMetadataTestJSON-228891847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.321s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:25 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-3edc259f-5f9d-4a01-b023-ab102fe3f24d tempest-SnapshotMetadataTestJSON-228891847 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:09:25 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3edc259f-5f9d-4a01-b023-ab102fe3f24d tempest-SnapshotMetadataTestJSON-228891847 None] Deleted volume successfully.
Nov 05 15:09:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3edc259f-5f9d-4a01-b023-ab102fe3f24d tempest-SnapshotMetadataTestJSON-228891847 None] Lock "cinder-1cbcdc86-5a34-4710-b6bd-c9474d307806-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:28 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:09:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Flow 'volume_create_manager' (ce301c2f-093a-4044-880e-281967f57988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:09:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d03e3cdb-b08b-479f-9bf4-33d74628cad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d03e3cdb-b08b-479f-9bf4-33d74628cad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-155422140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f65a2b6-4664-41cd-ae3b-91e68319100d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6521c37c86294e4cb5ab46c89ec7de7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:28Z,use_quota=True,user_id='4fe616c0ce484e9e959e4c36d84ce11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02db9d29-c701-4180-aa4e-5ad33d8122fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02db9d29-c701-4180-aa4e-5ad33d8122fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (269cee59-c1c1-4b26-a352-9be358501230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (269cee59-c1c1-4b26-a352-9be358501230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f65a2b6-4664-41cd-ae3b-91e68319100d', 'volume_name': 'volume-0f65a2b6-4664-41cd-ae3b-91e68319100d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39aa3a39-a187-4ffa-b748-83802f1a67a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39aa3a39-a187-4ffa-b748-83802f1a67a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6649674-a544-4c86-9b87-192049a0d5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:28 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Volume 0f65a2b6-4664-41cd-ae3b-91e68319100d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f65a2b6-4664-41cd-ae3b-91e68319100d', 'volume_size': 1}
Nov 05 15:09:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-155422140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f65a2b6-4664-41cd-ae3b-91e68319100d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6521c37c86294e4cb5ab46c89ec7de7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:28Z,use_quota=True,user_id='4fe616c0ce484e9e959e4c36d84ce11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:09:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Creating volume 0f65a2b6-4664-41cd-ae3b-91e68319100d {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:09:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:09:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:09:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:09:28 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:09:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0f65a2b6-4664-41cd-ae3b-91e68319100d 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:28 devstack sudo[95300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0f65a2b6-4664-41cd-ae3b-91e68319100d 1073741824
Nov 05 15:09:28 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:28 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0f65a2b6-4664-41cd-ae3b-91e68319100d 1073741824" returned: 0 in 0.470s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0f65a2b6-4664-41cd-ae3b-91e68319100d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:28 devstack sudo[95307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0f65a2b6-4664-41cd-ae3b-91e68319100d
Nov 05 15:09:28 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:29 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0f65a2b6-4664-41cd-ae3b-91e68319100d" returned: 0 in 0.277s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:09:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6649674-a544-4c86-9b87-192049a0d5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f65a2b6-4664-41cd-ae3b-91e68319100d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6502e3a7-3c49-4b8a-9aaf-6b1a4b9bb7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:29 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Volume volume-0f65a2b6-4664-41cd-ae3b-91e68319100d (0f65a2b6-4664-41cd-ae3b-91e68319100d): created successfully
Nov 05 15:09:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6502e3a7-3c49-4b8a-9aaf-6b1a4b9bb7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Flow 'volume_create_manager' (ce301c2f-093a-4044-880e-281967f57988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:09:29 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5b66a1b9-3b94-49fe-b1a9-d72dea44d8a2 tempest-VolumeQuotasNegativeTestJSON-413688857 None] Created volume successfully.
Nov 05 15:09:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8d82efdf-0c73-4f22-9f6c-0bcb49c32e5a tempest-VolumeQuotasNegativeTestJSON-413688857 None] Acquiring lock "cinder-0f65a2b6-4664-41cd-ae3b-91e68319100d-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8d82efdf-0c73-4f22-9f6c-0bcb49c32e5a tempest-VolumeQuotasNegativeTestJSON-413688857 None] Lock "cinder-0f65a2b6-4664-41cd-ae3b-91e68319100d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8d82efdf-0c73-4f22-9f6c-0bcb49c32e5a tempest-VolumeQuotasNegativeTestJSON-413688857 None] Acquiring lock "cinder-quobyte-0f65a2b6-4664-41cd-ae3b-91e68319100d" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8d82efdf-0c73-4f22-9f6c-0bcb49c32e5a tempest-VolumeQuotasNegativeTestJSON-413688857 None] Lock "cinder-quobyte-0f65a2b6-4664-41cd-ae3b-91e68319100d" acquired by "delete_volume" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:31 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c6aa4b-c519-49dd-9c34-113576ebcf9a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:09:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8d82efdf-0c73-4f22-9f6c-0bcb49c32e5a tempest-VolumeQuotasNegativeTestJSON-413688857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0f65a2b6-4664-41cd-ae3b-91e68319100d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:31 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:09:31 devstack sudo[95311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0f65a2b6-4664-41cd-ae3b-91e68319100d
Nov 05 15:09:31 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Flow 'volume_create_manager' (65898b77-3039-4d86-9100-4d93179f97b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:09:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743cb520-4bde-4eee-976b-6f3b22b71740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743cb520-4bde-4eee-976b-6f3b22b71740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-579459283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b7aa738-77be-4dae-80fb-2a5b48d4e4c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7048f5c366d4b82a77e473786989676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:32Z,use_quota=True,user_id='9c8c2f4178c14117b883ae7e843af190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccf63c83-5b9f-4c9a-be63-d9d67e84d330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccf63c83-5b9f-4c9a-be63-d9d67e84d330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4469b0-d75f-4e19-933f-3858ea68f82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4469b0-d75f-4e19-933f-3858ea68f82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b7aa738-77be-4dae-80fb-2a5b48d4e4c1', 'volume_name': 'volume-0b7aa738-77be-4dae-80fb-2a5b48d4e4c1', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa5f75d9-e6b4-4e8f-9891-263a61b9f935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa5f75d9-e6b4-4e8f-9891-263a61b9f935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc4ef226-0f98-4ba2-bffb-59e797f6cfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:31 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Volume 0b7aa738-77be-4dae-80fb-2a5b48d4e4c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b7aa738-77be-4dae-80fb-2a5b48d4e4c1', 'volume_size': 1}
Nov 05 15:09:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-579459283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b7aa738-77be-4dae-80fb-2a5b48d4e4c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7048f5c366d4b82a77e473786989676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:32Z,use_quota=True,user_id='9c8c2f4178c14117b883ae7e843af190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Creating volume 0b7aa738-77be-4dae-80fb-2a5b48d4e4c1 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:09:32 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b7aa738-77be-4dae-80fb-2a5b48d4e4c1 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:32 devstack sudo[95313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b7aa738-77be-4dae-80fb-2a5b48d4e4c1 1073741824
Nov 05 15:09:32 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:32 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8d82efdf-0c73-4f22-9f6c-0bcb49c32e5a tempest-VolumeQuotasNegativeTestJSON-413688857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0f65a2b6-4664-41cd-ae3b-91e68319100d" returned: 0 in 0.418s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8d82efdf-0c73-4f22-9f6c-0bcb49c32e5a tempest-VolumeQuotasNegativeTestJSON-413688857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0f65a2b6-4664-41cd-ae3b-91e68319100d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:32 devstack sudo[95318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0f65a2b6-4664-41cd-ae3b-91e68319100d
Nov 05 15:09:32 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:32 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8d82efdf-0c73-4f22-9f6c-0bcb49c32e5a tempest-VolumeQuotasNegativeTestJSON-413688857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0f65a2b6-4664-41cd-ae3b-91e68319100d" returned: 0 in 0.326s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:32 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b7aa738-77be-4dae-80fb-2a5b48d4e4c1 1073741824" returned: 0 in 0.549s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8d82efdf-0c73-4f22-9f6c-0bcb49c32e5a tempest-VolumeQuotasNegativeTestJSON-413688857 None] Lock "cinder-quobyte-0f65a2b6-4664-41cd-ae3b-91e68319100d" released by "delete_volume" :: held 0.804s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b7aa738-77be-4dae-80fb-2a5b48d4e4c1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:32 devstack sudo[95325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b7aa738-77be-4dae-80fb-2a5b48d4e4c1
Nov 05 15:09:32 devstack sudo[95325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-8d82efdf-0c73-4f22-9f6c-0bcb49c32e5a tempest-VolumeQuotasNegativeTestJSON-413688857 None] Created reservations ['c1444218-78aa-4966-95ef-e757a23845bd', 'b4e5b75a-63e3-430e-9e60-6a7b13a9b70a', '7f228074-2c4e-4b2a-8cc9-46afe9a9524b', '3d46f0c3-2d24-4b23-87bf-ebdfb488369f'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8d82efdf-0c73-4f22-9f6c-0bcb49c32e5a tempest-VolumeQuotasNegativeTestJSON-413688857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8d82efdf-0c73-4f22-9f6c-0bcb49c32e5a tempest-VolumeQuotasNegativeTestJSON-413688857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8d82efdf-0c73-4f22-9f6c-0bcb49c32e5a tempest-VolumeQuotasNegativeTestJSON-413688857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8d82efdf-0c73-4f22-9f6c-0bcb49c32e5a tempest-VolumeQuotasNegativeTestJSON-413688857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8d82efdf-0c73-4f22-9f6c-0bcb49c32e5a tempest-VolumeQuotasNegativeTestJSON-413688857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8d82efdf-0c73-4f22-9f6c-0bcb49c32e5a tempest-VolumeQuotasNegativeTestJSON-413688857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:32 devstack sudo[95327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:09:32 devstack sudo[95327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:32 devstack sudo[95325]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b7aa738-77be-4dae-80fb-2a5b48d4e4c1" returned: 0 in 0.353s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc4ef226-0f98-4ba2-bffb-59e797f6cfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b7aa738-77be-4dae-80fb-2a5b48d4e4c1', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518af321-40d2-4b71-a6f6-49d56a558d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:33 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Volume volume-0b7aa738-77be-4dae-80fb-2a5b48d4e4c1 (0b7aa738-77be-4dae-80fb-2a5b48d4e4c1): created successfully
Nov 05 15:09:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518af321-40d2-4b71-a6f6-49d56a558d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Flow 'volume_create_manager' (65898b77-3039-4d86-9100-4d93179f97b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:09:33 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-198f077e-6660-4ae4-8fc1-a6d465aebedd tempest-VolumesTransfersV355Test-572139921 None] Created volume successfully.
Nov 05 15:09:33 devstack sudo[95327]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8d82efdf-0c73-4f22-9f6c-0bcb49c32e5a tempest-VolumeQuotasNegativeTestJSON-413688857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.373s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:33 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-8d82efdf-0c73-4f22-9f6c-0bcb49c32e5a tempest-VolumeQuotasNegativeTestJSON-413688857 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:09:33 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-8d82efdf-0c73-4f22-9f6c-0bcb49c32e5a tempest-VolumeQuotasNegativeTestJSON-413688857 None] Deleted volume successfully.
Nov 05 15:09:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8d82efdf-0c73-4f22-9f6c-0bcb49c32e5a tempest-VolumeQuotasNegativeTestJSON-413688857 None] Lock "cinder-0f65a2b6-4664-41cd-ae3b-91e68319100d-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:35 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1cf5dbe2-15fe-4b84-b60c-1e4a6e15b98f tempest-VolumesTransfersV355Test-1943404520 None] Transfer volume completed successfully.
Nov 05 15:09:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-04792cc4-fbb3-4b77-8a92-38ddc23df6d3 tempest-VolumesTransfersV355Test-2093223563 None] Acquiring lock "cinder-0b7aa738-77be-4dae-80fb-2a5b48d4e4c1-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-04792cc4-fbb3-4b77-8a92-38ddc23df6d3 tempest-VolumesTransfersV355Test-2093223563 None] Lock "cinder-0b7aa738-77be-4dae-80fb-2a5b48d4e4c1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-04792cc4-fbb3-4b77-8a92-38ddc23df6d3 tempest-VolumesTransfersV355Test-2093223563 None] Acquiring lock "cinder-quobyte-0b7aa738-77be-4dae-80fb-2a5b48d4e4c1" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-04792cc4-fbb3-4b77-8a92-38ddc23df6d3 tempest-VolumesTransfersV355Test-2093223563 None] Lock "cinder-quobyte-0b7aa738-77be-4dae-80fb-2a5b48d4e4c1" acquired by "delete_volume" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:36 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a036176-6909-44d6-8f37-667bb6e2a10f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:09:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-04792cc4-fbb3-4b77-8a92-38ddc23df6d3 tempest-VolumesTransfersV355Test-2093223563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b7aa738-77be-4dae-80fb-2a5b48d4e4c1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:36 devstack sudo[95331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b7aa738-77be-4dae-80fb-2a5b48d4e4c1
Nov 05 15:09:36 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:36 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-04792cc4-fbb3-4b77-8a92-38ddc23df6d3 tempest-VolumesTransfersV355Test-2093223563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b7aa738-77be-4dae-80fb-2a5b48d4e4c1" returned: 0 in 0.418s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-04792cc4-fbb3-4b77-8a92-38ddc23df6d3 tempest-VolumesTransfersV355Test-2093223563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b7aa738-77be-4dae-80fb-2a5b48d4e4c1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:36 devstack sudo[95336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b7aa738-77be-4dae-80fb-2a5b48d4e4c1
Nov 05 15:09:36 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:37 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-04792cc4-fbb3-4b77-8a92-38ddc23df6d3 tempest-VolumesTransfersV355Test-2093223563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b7aa738-77be-4dae-80fb-2a5b48d4e4c1" returned: 0 in 0.268s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-04792cc4-fbb3-4b77-8a92-38ddc23df6d3 tempest-VolumesTransfersV355Test-2093223563 None] Lock "cinder-quobyte-0b7aa738-77be-4dae-80fb-2a5b48d4e4c1" released by "delete_volume" :: held 0.739s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:37 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-04792cc4-fbb3-4b77-8a92-38ddc23df6d3 tempest-VolumesTransfersV355Test-2093223563 None] Created reservations ['bc040db2-6311-45ce-b33a-2155f05fb2b2', '26db451e-0da8-421e-92b7-f2a08ce2d765', '827a9670-aec0-4a63-beea-7d059715fadf', '193d0a46-ac52-4b8b-bde8-74f120215f60'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:09:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-04792cc4-fbb3-4b77-8a92-38ddc23df6d3 tempest-VolumesTransfersV355Test-2093223563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-04792cc4-fbb3-4b77-8a92-38ddc23df6d3 tempest-VolumesTransfersV355Test-2093223563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-04792cc4-fbb3-4b77-8a92-38ddc23df6d3 tempest-VolumesTransfersV355Test-2093223563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:09:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-04792cc4-fbb3-4b77-8a92-38ddc23df6d3 tempest-VolumesTransfersV355Test-2093223563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:09:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-04792cc4-fbb3-4b77-8a92-38ddc23df6d3 tempest-VolumesTransfersV355Test-2093223563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-04792cc4-fbb3-4b77-8a92-38ddc23df6d3 tempest-VolumesTransfersV355Test-2093223563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:37 devstack sudo[95339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:09:37 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:09:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:09:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:09:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:37 devstack sudo[95341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:09:37 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:37 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-04792cc4-fbb3-4b77-8a92-38ddc23df6d3 tempest-VolumesTransfersV355Test-2093223563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.354s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-04792cc4-fbb3-4b77-8a92-38ddc23df6d3 tempest-VolumesTransfersV355Test-2093223563 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:09:37 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-04792cc4-fbb3-4b77-8a92-38ddc23df6d3 tempest-VolumesTransfersV355Test-2093223563 None] Deleted volume successfully.
Nov 05 15:09:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-04792cc4-fbb3-4b77-8a92-38ddc23df6d3 tempest-VolumesTransfersV355Test-2093223563 None] Lock "cinder-0b7aa738-77be-4dae-80fb-2a5b48d4e4c1-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:37 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.349s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:09:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:09:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 15:09:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread info: [<_MainThread(MainThread, started 136317437956224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136317326340928)>, <Thread(Thread-3 (stat_writer), started daemon 136317326487936)>, <Thread(Rabbit-heartbeat, started daemon 136317321464000)>, <Thread(Thread-5 (_runner), started daemon 136317321550592)>, <Thread(Thread-7 (_runner), started daemon 136317321658496)>, <Thread(fd_logger, started daemon 136317319612992)>, <Thread(privsep_reader, started daemon 136317319622400)>, <Thread(tpool_thread_0, started daemon 136317310928576)>, <Thread(tpool_thread_1, started daemon 136317302535872)>, <Thread(tpool_thread_2, started daemon 136317294143168)>, <Thread(tpool_thread_3, started daemon 136317285750464)>, <Thread(tpool_thread_4, started daemon 136317277357760)>, <Thread(tpool_thread_5, started daemon 136317268965056)>, <Thread(tpool_thread_6, started daemon 136317260572352)>, <Thread(tpool_thread_7, started daemon 136317252179648)>, <Thread(tpool_thread_8, started daemon 136317243786944)>, <Thread(tpool_thread_9, started daemon 136317235394240)>, <Thread(tpool_thread_10, started daemon 136317227001536)>, <Thread(tpool_thread_11, started daemon 136317218608832)>, <Thread(tpool_thread_12, started daemon 136317210216128)>, <Thread(tpool_thread_13, started daemon 136317201807040)>, <Thread(tpool_thread_14, started daemon 136317193397952)>, <Thread(tpool_thread_15, started daemon 136317184988864)>, <Thread(tpool_thread_16, started daemon 136317176579776)>, <Thread(tpool_thread_17, started daemon 136317168170688)>, <Thread(tpool_thread_18, started daemon 136317159761600)>, <Thread(tpool_thread_19, started daemon 136317151352512)>] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Flow 'volume_create_manager' (4cbfe80e-bf4c-4256-a263-95c22f8b91b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f44ae05-c08d-4825-8753-7ac6fa76d2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f44ae05-c08d-4825-8753-7ac6fa76d2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-836439650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5230f7-fcab-4572-a6f5-8a4d3ea3b931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7048f5c366d4b82a77e473786989676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:38Z,use_quota=True,user_id='9c8c2f4178c14117b883ae7e843af190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a85c03b-4fd3-491b-bb97-b17891ff814a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a85c03b-4fd3-491b-bb97-b17891ff814a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a7fc81a-a769-46ac-9a7e-aded77654066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a7fc81a-a769-46ac-9a7e-aded77654066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f5230f7-fcab-4572-a6f5-8a4d3ea3b931', 'volume_name': 'volume-4f5230f7-fcab-4572-a6f5-8a4d3ea3b931', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (226955ae-53ba-4798-b973-babbd241940c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (226955ae-53ba-4798-b973-babbd241940c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c7be53-de2c-4dd7-9587-4d036e74b490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:38 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Volume 4f5230f7-fcab-4572-a6f5-8a4d3ea3b931: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f5230f7-fcab-4572-a6f5-8a4d3ea3b931', 'volume_size': 1}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-836439650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5230f7-fcab-4572-a6f5-8a4d3ea3b931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7048f5c366d4b82a77e473786989676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:38Z,use_quota=True,user_id='9c8c2f4178c14117b883ae7e843af190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Creating volume 4f5230f7-fcab-4572-a6f5-8a4d3ea3b931 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:09:38 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4f5230f7-fcab-4572-a6f5-8a4d3ea3b931 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:38 devstack sudo[95347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4f5230f7-fcab-4572-a6f5-8a4d3ea3b931 1073741824
Nov 05 15:09:38 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Flow 'volume_create_manager' (680d4f7f-f18d-4e42-bc2e-832dbd8b189a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3dc5d0-b836-4b1b-b083-d8fe97d6590e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3dc5d0-b836-4b1b-b083-d8fe97d6590e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-374498184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d07ffac128f41ddbc24a66e19ec3851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:39Z,use_quota=True,user_id='ca8c4e1c1471488d9527bd872f4a9b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e3d708-cbef-46d9-9b36-cb648016c3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e3d708-cbef-46d9-9b36-cb648016c3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd39526-f8b1-482b-8e92-db4acb63cf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd39526-f8b1-482b-8e92-db4acb63cf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3', 'volume_name': 'volume-0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5be313-a5a9-464a-b131-984eae9f1f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5be313-a5a9-464a-b131-984eae9f1f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8272cf4-48ca-4e4c-95a8-ca07f39614b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:38 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Volume 0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3', 'volume_size': 1}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:38 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4f5230f7-fcab-4572-a6f5-8a4d3ea3b931 1073741824" returned: 0 in 0.662s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4f5230f7-fcab-4572-a6f5-8a4d3ea3b931 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:38 devstack sudo[95354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4f5230f7-fcab-4572-a6f5-8a4d3ea3b931
Nov 05 15:09:38 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:39 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4f5230f7-fcab-4572-a6f5-8a4d3ea3b931" returned: 0 in 0.303s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:09:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.441s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-374498184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d07ffac128f41ddbc24a66e19ec3851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:39Z,use_quota=True,user_id='ca8c4e1c1471488d9527bd872f4a9b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:09:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Creating volume 0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:09:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:09:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:09:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:09:39 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:09:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c7be53-de2c-4dd7-9587-4d036e74b490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f5230f7-fcab-4572-a6f5-8a4d3ea3b931', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41fd3445-5b91-46c9-a727-b4657b117256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:39 devstack sudo[95357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3 1073741824
Nov 05 15:09:39 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:39 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Volume volume-4f5230f7-fcab-4572-a6f5-8a4d3ea3b931 (4f5230f7-fcab-4572-a6f5-8a4d3ea3b931): created successfully
Nov 05 15:09:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41fd3445-5b91-46c9-a727-b4657b117256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Flow 'volume_create_manager' (4cbfe80e-bf4c-4256-a263-95c22f8b91b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:09:39 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-abc91766-b9a6-474e-8834-400a1f4c7bd1 tempest-VolumesTransfersV355Test-572139921 None] Created volume successfully.
Nov 05 15:09:39 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3 1073741824" returned: 0 in 0.562s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:39 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:INSERT=37,cinder:UPDATE=135,cinder:SELECT=118,cinder:DELETE=10 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:09:39 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=91,cinder:INSERT=41,cinder:UPDATE=141,cinder:DELETE=12 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:09:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:39 devstack sudo[95363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3
Nov 05 15:09:39 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:40 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3" returned: 0 in 0.296s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:09:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8272cf4-48ca-4e4c-95a8-ca07f39614b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c51b50d3-6e17-476d-b9e3-dc79607b75b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:40 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Volume volume-0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3 (0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3): created successfully
Nov 05 15:09:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c51b50d3-6e17-476d-b9e3-dc79607b75b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Flow 'volume_create_manager' (680d4f7f-f18d-4e42-bc2e-832dbd8b189a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:09:40 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-047d89b7-adc0-4d2c-bbd9-6de36071653d tempest-AttachVolumeShelveTestJSON-1011516400 None] Created volume successfully.
Nov 05 15:09:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a7cbdb84-a5e5-4723-8e8d-b6d1ee689bdf tempest-VolumesTransfersV355Test-2093223563 None] Acquiring lock "cinder-4f5230f7-fcab-4572-a6f5-8a4d3ea3b931-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a7cbdb84-a5e5-4723-8e8d-b6d1ee689bdf tempest-VolumesTransfersV355Test-2093223563 None] Lock "cinder-4f5230f7-fcab-4572-a6f5-8a4d3ea3b931-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a7cbdb84-a5e5-4723-8e8d-b6d1ee689bdf tempest-VolumesTransfersV355Test-2093223563 None] Acquiring lock "cinder-quobyte-4f5230f7-fcab-4572-a6f5-8a4d3ea3b931" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a7cbdb84-a5e5-4723-8e8d-b6d1ee689bdf tempest-VolumesTransfersV355Test-2093223563 None] Lock "cinder-quobyte-4f5230f7-fcab-4572-a6f5-8a4d3ea3b931" acquired by "delete_volume" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:40 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[106f71cc-d340-407d-9f4f-8cf5972b7b92]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:09:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a7cbdb84-a5e5-4723-8e8d-b6d1ee689bdf tempest-VolumesTransfersV355Test-2093223563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4f5230f7-fcab-4572-a6f5-8a4d3ea3b931 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:40 devstack sudo[95366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4f5230f7-fcab-4572-a6f5-8a4d3ea3b931
Nov 05 15:09:40 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:41 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a7cbdb84-a5e5-4723-8e8d-b6d1ee689bdf tempest-VolumesTransfersV355Test-2093223563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4f5230f7-fcab-4572-a6f5-8a4d3ea3b931" returned: 0 in 0.435s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a7cbdb84-a5e5-4723-8e8d-b6d1ee689bdf tempest-VolumesTransfersV355Test-2093223563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4f5230f7-fcab-4572-a6f5-8a4d3ea3b931 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:41 devstack sudo[95375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4f5230f7-fcab-4572-a6f5-8a4d3ea3b931
Nov 05 15:09:41 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Flow 'volume_create_manager' (b56c8595-5d33-4b35-8e5b-6239f3be1a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979c3f1f-7161-49ac-b9e9-0bf4af267cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979c3f1f-7161-49ac-b9e9-0bf4af267cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1249051889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81341002-332c-47b2-8bdd-cc3cc39faf13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d7b2e0a37149d2a75af0a477f179ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:41Z,use_quota=True,user_id='b0c16b8784cc4f11b3f719856827862b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2f7589-f162-49f5-895c-eb7b9ebc30a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2f7589-f162-49f5-895c-eb7b9ebc30a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a5a450-d3c4-4d0d-a026-82e78d957f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a5a450-d3c4-4d0d-a026-82e78d957f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81341002-332c-47b2-8bdd-cc3cc39faf13', 'volume_name': 'volume-81341002-332c-47b2-8bdd-cc3cc39faf13', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d9a451-c908-4b5d-8b86-961f39dddd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d9a451-c908-4b5d-8b86-961f39dddd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb7604b0-6753-43ae-a3e2-217fa94a4f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:41 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Volume 81341002-332c-47b2-8bdd-cc3cc39faf13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81341002-332c-47b2-8bdd-cc3cc39faf13', 'volume_size': 1}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1249051889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81341002-332c-47b2-8bdd-cc3cc39faf13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d7b2e0a37149d2a75af0a477f179ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:41Z,use_quota=True,user_id='b0c16b8784cc4f11b3f719856827862b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Creating volume 81341002-332c-47b2-8bdd-cc3cc39faf13 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:09:41 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:09:41 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-81341002-332c-47b2-8bdd-cc3cc39faf13 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a7cbdb84-a5e5-4723-8e8d-b6d1ee689bdf tempest-VolumesTransfersV355Test-2093223563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4f5230f7-fcab-4572-a6f5-8a4d3ea3b931" returned: 0 in 0.420s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:41 devstack sudo[95378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-81341002-332c-47b2-8bdd-cc3cc39faf13 1073741824
Nov 05 15:09:41 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a7cbdb84-a5e5-4723-8e8d-b6d1ee689bdf tempest-VolumesTransfersV355Test-2093223563 None] Lock "cinder-quobyte-4f5230f7-fcab-4572-a6f5-8a4d3ea3b931" released by "delete_volume" :: held 0.942s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-a7cbdb84-a5e5-4723-8e8d-b6d1ee689bdf tempest-VolumesTransfersV355Test-2093223563 None] Created reservations ['d7202c9e-851b-4e17-89f5-5f794187d3a3', '40416091-2f69-4ddd-b021-678bec49c88c', '06537bb4-0df3-40b8-8049-95bf890d5f50', '62ac09fa-0a34-4216-b800-ac504657847f'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a7cbdb84-a5e5-4723-8e8d-b6d1ee689bdf tempest-VolumesTransfersV355Test-2093223563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a7cbdb84-a5e5-4723-8e8d-b6d1ee689bdf tempest-VolumesTransfersV355Test-2093223563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a7cbdb84-a5e5-4723-8e8d-b6d1ee689bdf tempest-VolumesTransfersV355Test-2093223563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a7cbdb84-a5e5-4723-8e8d-b6d1ee689bdf tempest-VolumesTransfersV355Test-2093223563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a7cbdb84-a5e5-4723-8e8d-b6d1ee689bdf tempest-VolumesTransfersV355Test-2093223563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a7cbdb84-a5e5-4723-8e8d-b6d1ee689bdf tempest-VolumesTransfersV355Test-2093223563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:41 devstack sudo[95380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:09:41 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:41 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a7cbdb84-a5e5-4723-8e8d-b6d1ee689bdf tempest-VolumesTransfersV355Test-2093223563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.325s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:41 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a7cbdb84-a5e5-4723-8e8d-b6d1ee689bdf tempest-VolumesTransfersV355Test-2093223563 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:09:42 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a7cbdb84-a5e5-4723-8e8d-b6d1ee689bdf tempest-VolumesTransfersV355Test-2093223563 None] Deleted volume successfully.
Nov 05 15:09:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a7cbdb84-a5e5-4723-8e8d-b6d1ee689bdf tempest-VolumesTransfersV355Test-2093223563 None] Lock "cinder-4f5230f7-fcab-4572-a6f5-8a4d3ea3b931-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:42 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-81341002-332c-47b2-8bdd-cc3cc39faf13 1073741824" returned: 0 in 0.594s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-81341002-332c-47b2-8bdd-cc3cc39faf13 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:42 devstack sudo[95386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-81341002-332c-47b2-8bdd-cc3cc39faf13
Nov 05 15:09:42 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:42 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-81341002-332c-47b2-8bdd-cc3cc39faf13" returned: 0 in 0.342s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:09:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb7604b0-6753-43ae-a3e2-217fa94a4f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81341002-332c-47b2-8bdd-cc3cc39faf13', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad076c8c-09d6-48bc-8aef-0b3552e4dfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:42 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Volume volume-81341002-332c-47b2-8bdd-cc3cc39faf13 (81341002-332c-47b2-8bdd-cc3cc39faf13): created successfully
Nov 05 15:09:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad076c8c-09d6-48bc-8aef-0b3552e4dfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Flow 'volume_create_manager' (b56c8595-5d33-4b35-8e5b-6239f3be1a9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:09:42 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c2d41af3-aa0d-4232-bea5-d4fd952ff529 tempest-VolumesServicesTestJSON-503387200 None] Created volume successfully.
Nov 05 15:09:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-aeef0396-6ba6-4841-8294-4c88881042a2 tempest-VolumesServicesTestJSON-503387200 None] Acquiring lock "cinder-81341002-332c-47b2-8bdd-cc3cc39faf13-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-aeef0396-6ba6-4841-8294-4c88881042a2 tempest-VolumesServicesTestJSON-503387200 None] Lock "cinder-81341002-332c-47b2-8bdd-cc3cc39faf13-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-aeef0396-6ba6-4841-8294-4c88881042a2 tempest-VolumesServicesTestJSON-503387200 None] Acquiring lock "cinder-quobyte-81341002-332c-47b2-8bdd-cc3cc39faf13" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-aeef0396-6ba6-4841-8294-4c88881042a2 tempest-VolumesServicesTestJSON-503387200 None] Lock "cinder-quobyte-81341002-332c-47b2-8bdd-cc3cc39faf13" acquired by "delete_volume" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:43 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28c2a1f-b217-4b85-85e8-c8598902dc74]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:09:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aeef0396-6ba6-4841-8294-4c88881042a2 tempest-VolumesServicesTestJSON-503387200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-81341002-332c-47b2-8bdd-cc3cc39faf13 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:44 devstack sudo[95403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-81341002-332c-47b2-8bdd-cc3cc39faf13
Nov 05 15:09:44 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:44 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aeef0396-6ba6-4841-8294-4c88881042a2 tempest-VolumesServicesTestJSON-503387200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-81341002-332c-47b2-8bdd-cc3cc39faf13" returned: 0 in 0.654s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aeef0396-6ba6-4841-8294-4c88881042a2 tempest-VolumesServicesTestJSON-503387200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-81341002-332c-47b2-8bdd-cc3cc39faf13 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:44 devstack sudo[95409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-81341002-332c-47b2-8bdd-cc3cc39faf13
Nov 05 15:09:44 devstack sudo[95409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:44 devstack sudo[95409]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aeef0396-6ba6-4841-8294-4c88881042a2 tempest-VolumesServicesTestJSON-503387200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-81341002-332c-47b2-8bdd-cc3cc39faf13" returned: 0 in 0.291s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-aeef0396-6ba6-4841-8294-4c88881042a2 tempest-VolumesServicesTestJSON-503387200 None] Lock "cinder-quobyte-81341002-332c-47b2-8bdd-cc3cc39faf13" released by "delete_volume" :: held 1.036s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:44 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-aeef0396-6ba6-4841-8294-4c88881042a2 tempest-VolumesServicesTestJSON-503387200 None] Created reservations ['5c943f81-fdd6-4dc3-bfbd-95720e593861', '04560557-1439-4293-a430-9a761b24d1d5', '3dd9d877-6d66-46df-bf0a-ee7d5a9a8000', '90220db3-0723-43b7-ac7e-e27eab4f6839'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:09:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aeef0396-6ba6-4841-8294-4c88881042a2 tempest-VolumesServicesTestJSON-503387200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aeef0396-6ba6-4841-8294-4c88881042a2 tempest-VolumesServicesTestJSON-503387200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-aeef0396-6ba6-4841-8294-4c88881042a2 tempest-VolumesServicesTestJSON-503387200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:09:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-aeef0396-6ba6-4841-8294-4c88881042a2 tempest-VolumesServicesTestJSON-503387200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:09:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aeef0396-6ba6-4841-8294-4c88881042a2 tempest-VolumesServicesTestJSON-503387200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aeef0396-6ba6-4841-8294-4c88881042a2 tempest-VolumesServicesTestJSON-503387200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:45 devstack sudo[95412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:09:45 devstack sudo[95412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:45 devstack sudo[95412]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aeef0396-6ba6-4841-8294-4c88881042a2 tempest-VolumesServicesTestJSON-503387200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.306s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:45 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-aeef0396-6ba6-4841-8294-4c88881042a2 tempest-VolumesServicesTestJSON-503387200 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:09:45 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-aeef0396-6ba6-4841-8294-4c88881042a2 tempest-VolumesServicesTestJSON-503387200 None] Deleted volume successfully.
Nov 05 15:09:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-aeef0396-6ba6-4841-8294-4c88881042a2 tempest-VolumesServicesTestJSON-503387200 None] Lock "cinder-81341002-332c-47b2-8bdd-cc3cc39faf13-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-1e3e2a32-e6c1-49c1-ba65-d9f80fce55fa req-9a8ae233-7652-4dac-a983-51962bfc9b59 tempest-AttachVolumeShelveTestJSON-1011516400 None] No connector for attachment 4b69eadb-390b-4310-8a35-e9934d9e41de; skipping storage backend terminate_connection call. {{(pid=87150) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Nov 05 15:09:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-1e3e2a32-e6c1-49c1-ba65-d9f80fce55fa req-9a8ae233-7652-4dac-a983-51962bfc9b59 tempest-AttachVolumeShelveTestJSON-1011516400 None] Deleting attachment 4b69eadb-390b-4310-8a35-e9934d9e41de. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 15:09:54 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:09:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Flow 'volume_create_manager' (3a7541ed-37f2-4c90-9a11-6a460f885e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:09:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54719437-1802-421a-823d-13149cabb7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54719437-1802-421a-823d-13149cabb7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1672160836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8c8c987-fb04-4b11-9489-0c35b933c98b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='736a954ef32e4cfcab574b4482603660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:54Z,use_quota=True,user_id='0b98f3c5763d43de98c5ee27cf39ae5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f94cb4-c63d-4ca2-9468-3bf2a48fc6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f94cb4-c63d-4ca2-9468-3bf2a48fc6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8086d29-abf0-4f60-868b-5fe7a7fe4746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8086d29-abf0-4f60-868b-5fe7a7fe4746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8c8c987-fb04-4b11-9489-0c35b933c98b', 'volume_name': 'volume-f8c8c987-fb04-4b11-9489-0c35b933c98b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0e1faf-4b39-4ddf-9860-f98f3a45f4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0e1faf-4b39-4ddf-9860-f98f3a45f4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785ab134-438f-4d00-a021-67eb55779ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:54 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Volume f8c8c987-fb04-4b11-9489-0c35b933c98b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8c8c987-fb04-4b11-9489-0c35b933c98b', 'volume_size': 1}
Nov 05 15:09:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1672160836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8c8c987-fb04-4b11-9489-0c35b933c98b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='736a954ef32e4cfcab574b4482603660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:54Z,use_quota=True,user_id='0b98f3c5763d43de98c5ee27cf39ae5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:09:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Creating volume f8c8c987-fb04-4b11-9489-0c35b933c98b {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:09:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:09:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:09:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:09:54 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:09:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f8c8c987-fb04-4b11-9489-0c35b933c98b 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:54 devstack sudo[95438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f8c8c987-fb04-4b11-9489-0c35b933c98b 1073741824
Nov 05 15:09:54 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:54 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f8c8c987-fb04-4b11-9489-0c35b933c98b 1073741824" returned: 0 in 0.610s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f8c8c987-fb04-4b11-9489-0c35b933c98b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:54 devstack sudo[95443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f8c8c987-fb04-4b11-9489-0c35b933c98b
Nov 05 15:09:54 devstack sudo[95443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:55 devstack sudo[95443]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f8c8c987-fb04-4b11-9489-0c35b933c98b" returned: 0 in 0.420s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:09:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785ab134-438f-4d00-a021-67eb55779ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8c8c987-fb04-4b11-9489-0c35b933c98b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce7dc31-4152-4c84-895d-7ac49933e6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:55 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Volume volume-f8c8c987-fb04-4b11-9489-0c35b933c98b (f8c8c987-fb04-4b11-9489-0c35b933c98b): created successfully
Nov 05 15:09:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce7dc31-4152-4c84-895d-7ac49933e6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Flow 'volume_create_manager' (3a7541ed-37f2-4c90-9a11-6a460f885e90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:09:55 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b2c98a4d-1eee-476b-a3ec-3e49eaa53725 tempest-VolumesTransfersV357Test-894724110 None] Created volume successfully.
Nov 05 15:09:56 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:09:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Flow 'volume_create_manager' (598efca9-d1c2-4c01-8c6e-153f7cae88cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:09:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f8f76e7-a701-4d17-adf4-71dd1388e5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f8f76e7-a701-4d17-adf4-71dd1388e5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-78718807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=932fdb9a-be61-444c-a85b-8b847d966f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc1cb61ca05444db312ef6cfe24df4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:57Z,use_quota=True,user_id='223f2dcb86b14248afc22357e12c10b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86987acd-d535-4c71-8949-1393926eef85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86987acd-d535-4c71-8949-1393926eef85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2358b5a6-dcc6-4202-a812-cd42c5f0e6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2358b5a6-dcc6-4202-a812-cd42c5f0e6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '932fdb9a-be61-444c-a85b-8b847d966f5f', 'volume_name': 'volume-932fdb9a-be61-444c-a85b-8b847d966f5f', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a227c529-a95c-4b08-9036-d0c8ecdc53c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a227c529-a95c-4b08-9036-d0c8ecdc53c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (660d7518-f103-41f4-b4c1-95a9054110b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:56 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Volume 932fdb9a-be61-444c-a85b-8b847d966f5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-932fdb9a-be61-444c-a85b-8b847d966f5f', 'volume_size': 1}
Nov 05 15:09:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-78718807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=932fdb9a-be61-444c-a85b-8b847d966f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc1cb61ca05444db312ef6cfe24df4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:57Z,use_quota=True,user_id='223f2dcb86b14248afc22357e12c10b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:09:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Creating volume 932fdb9a-be61-444c-a85b-8b847d966f5f {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:09:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:09:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:09:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:09:56 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:09:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:57 devstack sudo[95449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f 1073741824
Nov 05 15:09:57 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:57 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f 1073741824" returned: 0 in 0.634s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:57 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-487dd8ec-3168-4ed7-8479-d2d9e38801dc tempest-VolumesTransfersV357Test-728080068 None] Transfer volume completed successfully.
Nov 05 15:09:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:57 devstack sudo[95455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f
Nov 05 15:09:57 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:58 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f" returned: 0 in 0.371s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:09:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (660d7518-f103-41f4-b4c1-95a9054110b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-932fdb9a-be61-444c-a85b-8b847d966f5f', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c92423-091e-4cd3-a644-3e8a4a304a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:09:58 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Volume volume-932fdb9a-be61-444c-a85b-8b847d966f5f (932fdb9a-be61-444c-a85b-8b847d966f5f): created successfully
Nov 05 15:09:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c92423-091e-4cd3-a644-3e8a4a304a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:09:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Flow 'volume_create_manager' (598efca9-d1c2-4c01-8c6e-153f7cae88cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:09:58 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-20a3b1a1-8172-4b27-9844-5d75ae28f6b4 tempest-VolumesDeleteCascade-2046481341 None] Created volume successfully.
Nov 05 15:09:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0d735fcc-fba6-41a8-bd8f-06955e2d44a0 tempest-VolumesTransfersV357Test-882718906 None] Acquiring lock "cinder-f8c8c987-fb04-4b11-9489-0c35b933c98b-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0d735fcc-fba6-41a8-bd8f-06955e2d44a0 tempest-VolumesTransfersV357Test-882718906 None] Lock "cinder-f8c8c987-fb04-4b11-9489-0c35b933c98b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0d735fcc-fba6-41a8-bd8f-06955e2d44a0 tempest-VolumesTransfersV357Test-882718906 None] Acquiring lock "cinder-quobyte-f8c8c987-fb04-4b11-9489-0c35b933c98b" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:09:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0d735fcc-fba6-41a8-bd8f-06955e2d44a0 tempest-VolumesTransfersV357Test-882718906 None] Lock "cinder-quobyte-f8c8c987-fb04-4b11-9489-0c35b933c98b" acquired by "delete_volume" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:09:58 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[515594bd-0ca4-4a3e-be00-dd03571a423c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:09:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0d735fcc-fba6-41a8-bd8f-06955e2d44a0 tempest-VolumesTransfersV357Test-882718906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f8c8c987-fb04-4b11-9489-0c35b933c98b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:58 devstack sudo[95460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f8c8c987-fb04-4b11-9489-0c35b933c98b
Nov 05 15:09:58 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:59 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0d735fcc-fba6-41a8-bd8f-06955e2d44a0 tempest-VolumesTransfersV357Test-882718906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f8c8c987-fb04-4b11-9489-0c35b933c98b" returned: 0 in 0.501s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0d735fcc-fba6-41a8-bd8f-06955e2d44a0 tempest-VolumesTransfersV357Test-882718906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f8c8c987-fb04-4b11-9489-0c35b933c98b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-abb1a1aa-f3dc-4ba6-b56c-7082f30b6176 tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-abb1a1aa-f3dc-4ba6-b56c-7082f30b6176 tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:59 devstack sudo[95465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f8c8c987-fb04-4b11-9489-0c35b933c98b
Nov 05 15:09:59 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-abb1a1aa-f3dc-4ba6-b56c-7082f30b6176 tempest-VolumesDeleteCascade-2046481341 None] Creating offline snapshot 5186bdd2-1a11-42bf-bacc-c8e167a74ff2 of volume 932fdb9a-be61-444c-a85b-8b847d966f5f {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:09:59 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[028689cf-e97b-4457-b77c-0f217d9e394c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:09:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abb1a1aa-f3dc-4ba6-b56c-7082f30b6176 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:59 devstack sudo[95467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f
Nov 05 15:09:59 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:09:59 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root
Nov 05 15:09:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0d735fcc-fba6-41a8-bd8f-06955e2d44a0 tempest-VolumesTransfersV357Test-882718906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f8c8c987-fb04-4b11-9489-0c35b933c98b" returned: 0 in 0.327s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:09:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0d735fcc-fba6-41a8-bd8f-06955e2d44a0 tempest-VolumesTransfersV357Test-882718906 None] Lock "cinder-quobyte-f8c8c987-fb04-4b11-9489-0c35b933c98b" released by "delete_volume" :: held 0.890s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:09:59 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-0d735fcc-fba6-41a8-bd8f-06955e2d44a0 tempest-VolumesTransfersV357Test-882718906 None] Created reservations ['4eb885d2-0a23-4e09-9d74-7545a72cdae7', '568c6f92-d3bd-4046-b7b7-783951a5a50f', '72a7ce15-7a22-4239-b58e-2358a1f4432d', 'e53c5c70-bbed-4c3c-ac59-ecae7f3de121'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:09:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0d735fcc-fba6-41a8-bd8f-06955e2d44a0 tempest-VolumesTransfersV357Test-882718906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:09:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0d735fcc-fba6-41a8-bd8f-06955e2d44a0 tempest-VolumesTransfersV357Test-882718906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:09:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0d735fcc-fba6-41a8-bd8f-06955e2d44a0 tempest-VolumesTransfersV357Test-882718906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:09:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0d735fcc-fba6-41a8-bd8f-06955e2d44a0 tempest-VolumesTransfersV357Test-882718906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:09:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0d735fcc-fba6-41a8-bd8f-06955e2d44a0 tempest-VolumesTransfersV357Test-882718906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:09:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0d735fcc-fba6-41a8-bd8f-06955e2d44a0 tempest-VolumesTransfersV357Test-882718906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:09:59 devstack sudo[95473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:09:59 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:00 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abb1a1aa-f3dc-4ba6-b56c-7082f30b6176 tempest-VolumesDeleteCascade-2046481341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f" returned: 0 in 0.706s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abb1a1aa-f3dc-4ba6-b56c-7082f30b6176 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:00 devstack sudo[95475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2 1G
Nov 05 15:10:00 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:00 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0d735fcc-fba6-41a8-bd8f-06955e2d44a0 tempest-VolumesTransfersV357Test-882718906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.432s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:00 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-0d735fcc-fba6-41a8-bd8f-06955e2d44a0 tempest-VolumesTransfersV357Test-882718906 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:10:00 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0d735fcc-fba6-41a8-bd8f-06955e2d44a0 tempest-VolumesTransfersV357Test-882718906 None] Deleted volume successfully.
Nov 05 15:10:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0d735fcc-fba6-41a8-bd8f-06955e2d44a0 tempest-VolumesTransfersV357Test-882718906 None] Lock "cinder-f8c8c987-fb04-4b11-9489-0c35b933c98b-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:00 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abb1a1aa-f3dc-4ba6-b56c-7082f30b6176 tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2 1G" returned: 0 in 0.698s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abb1a1aa-f3dc-4ba6-b56c-7082f30b6176 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932fdb9a-be61-444c-a85b-8b847d966f5f -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:00 devstack sudo[95482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932fdb9a-be61-444c-a85b-8b847d966f5f -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2
Nov 05 15:10:00 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:01 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abb1a1aa-f3dc-4ba6-b56c-7082f30b6176 tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932fdb9a-be61-444c-a85b-8b847d966f5f -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2" returned: 0 in 0.390s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:01 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-abb1a1aa-f3dc-4ba6-b56c-7082f30b6176 tempest-VolumesDeleteCascade-2046481341 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2 is being set with open permissions: ugo+rw
Nov 05 15:10:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abb1a1aa-f3dc-4ba6-b56c-7082f30b6176 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:01 devstack sudo[95487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2
Nov 05 15:10:01 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:01 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abb1a1aa-f3dc-4ba6-b56c-7082f30b6176 tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2" returned: 0 in 0.352s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abb1a1aa-f3dc-4ba6-b56c-7082f30b6176 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:01 devstack sudo[95498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.info
Nov 05 15:10:01 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:01 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:10:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Flow 'volume_create_manager' (ddfff7c8-c435-4488-a046-9ebb2cad4493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:10:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dbd7e25-4bf9-42a9-987b-d5e7d82c4f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dbd7e25-4bf9-42a9-987b-d5e7d82c4f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-892305591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9768d102-7993-4229-9a8a-5ac3ba2d9085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='736a954ef32e4cfcab574b4482603660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:10:02Z,use_quota=True,user_id='0b98f3c5763d43de98c5ee27cf39ae5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d911d0d8-652b-426b-b8a7-a1d82cc29e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d911d0d8-652b-426b-b8a7-a1d82cc29e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6dc13e5-6fef-4f1e-a07a-28d083088171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6dc13e5-6fef-4f1e-a07a-28d083088171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9768d102-7993-4229-9a8a-5ac3ba2d9085', 'volume_name': 'volume-9768d102-7993-4229-9a8a-5ac3ba2d9085', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31e7dd4-aa88-4734-a739-58f201d6f489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31e7dd4-aa88-4734-a739-58f201d6f489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d81879c-2630-4b35-8279-31324d902c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:01 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Volume 9768d102-7993-4229-9a8a-5ac3ba2d9085: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9768d102-7993-4229-9a8a-5ac3ba2d9085', 'volume_size': 1}
Nov 05 15:10:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:10:01 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abb1a1aa-f3dc-4ba6-b56c-7082f30b6176 tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.info" returned: 0 in 0.338s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:01 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-abb1a1aa-f3dc-4ba6-b56c-7082f30b6176 tempest-VolumesDeleteCascade-2046481341 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.info is being set with open permissions: ugo+rw
Nov 05 15:10:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abb1a1aa-f3dc-4ba6-b56c-7082f30b6176 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:01 devstack sudo[95505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.info
Nov 05 15:10:01 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:02 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abb1a1aa-f3dc-4ba6-b56c-7082f30b6176 tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.info" returned: 0 in 0.267s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-abb1a1aa-f3dc-4ba6-b56c-7082f30b6176 tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.886s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.378s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-892305591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9768d102-7993-4229-9a8a-5ac3ba2d9085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='736a954ef32e4cfcab574b4482603660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:10:02Z,use_quota=True,user_id='0b98f3c5763d43de98c5ee27cf39ae5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Creating volume 9768d102-7993-4229-9a8a-5ac3ba2d9085 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:10:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:10:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:10:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:10:02 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:10:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9768d102-7993-4229-9a8a-5ac3ba2d9085 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:02 devstack sudo[95514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9768d102-7993-4229-9a8a-5ac3ba2d9085 1073741824
Nov 05 15:10:02 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:02 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-abb1a1aa-f3dc-4ba6-b56c-7082f30b6176 tempest-VolumesDeleteCascade-2046481341 None] Create snapshot completed successfully
Nov 05 15:10:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-35af9ff0-31e5-465e-886e-caff579c0d2a tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:10:02 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9768d102-7993-4229-9a8a-5ac3ba2d9085 1073741824" returned: 0 in 0.576s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9768d102-7993-4229-9a8a-5ac3ba2d9085 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:02 devstack sudo[95532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9768d102-7993-4229-9a8a-5ac3ba2d9085
Nov 05 15:10:02 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:03 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9768d102-7993-4229-9a8a-5ac3ba2d9085" returned: 0 in 0.296s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:10:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-35af9ff0-31e5-465e-886e-caff579c0d2a tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.376s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:10:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d81879c-2630-4b35-8279-31324d902c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9768d102-7993-4229-9a8a-5ac3ba2d9085', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af6a396-85c7-4aec-bfde-8dd563556849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-35af9ff0-31e5-465e-886e-caff579c0d2a tempest-VolumesDeleteCascade-2046481341 None] Creating offline snapshot 7ce9ce78-3dcc-4e4e-aa87-84253575c39e of volume 932fdb9a-be61-444c-a85b-8b847d966f5f {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:10:03 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Volume volume-9768d102-7993-4229-9a8a-5ac3ba2d9085 (9768d102-7993-4229-9a8a-5ac3ba2d9085): created successfully
Nov 05 15:10:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af6a396-85c7-4aec-bfde-8dd563556849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Flow 'volume_create_manager' (ddfff7c8-c435-4488-a046-9ebb2cad4493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:10:03 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d541f8f-dd54-48c8-940f-e719d526a391]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-35af9ff0-31e5-465e-886e-caff579c0d2a tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-43cf13f3-a491-4ccb-8a2d-960659e28397 tempest-VolumesTransfersV357Test-894724110 None] Created volume successfully.
Nov 05 15:10:03 devstack sudo[95541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2
Nov 05 15:10:03 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:03 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-35af9ff0-31e5-465e-886e-caff579c0d2a tempest-VolumesDeleteCascade-2046481341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2" returned: 0 in 0.561s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-35af9ff0-31e5-465e-886e-caff579c0d2a tempest-VolumesDeleteCascade-2046481341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-932fdb9a-be61-444c-a85b-8b847d966f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:10:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-35af9ff0-31e5-465e-886e-caff579c0d2a tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:03 devstack sudo[95546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e 1G
Nov 05 15:10:03 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ed17b897-ac97-4c54-bd94-d19b378e455a tempest-VolumesTransfersV357Test-882718906 None] Acquiring lock "cinder-9768d102-7993-4229-9a8a-5ac3ba2d9085-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ed17b897-ac97-4c54-bd94-d19b378e455a tempest-VolumesTransfersV357Test-882718906 None] Lock "cinder-9768d102-7993-4229-9a8a-5ac3ba2d9085-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ed17b897-ac97-4c54-bd94-d19b378e455a tempest-VolumesTransfersV357Test-882718906 None] Acquiring lock "cinder-quobyte-9768d102-7993-4229-9a8a-5ac3ba2d9085" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ed17b897-ac97-4c54-bd94-d19b378e455a tempest-VolumesTransfersV357Test-882718906 None] Lock "cinder-quobyte-9768d102-7993-4229-9a8a-5ac3ba2d9085" acquired by "delete_volume" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:04 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[649b6d24-c822-4d2d-b5a5-66da9548f2f8]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ed17b897-ac97-4c54-bd94-d19b378e455a tempest-VolumesTransfersV357Test-882718906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9768d102-7993-4229-9a8a-5ac3ba2d9085 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:04 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-35af9ff0-31e5-465e-886e-caff579c0d2a tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e 1G" returned: 0 in 0.662s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-35af9ff0-31e5-465e-886e-caff579c0d2a tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:04 devstack sudo[95553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e
Nov 05 15:10:04 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:04 devstack sudo[95552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9768d102-7993-4229-9a8a-5ac3ba2d9085
Nov 05 15:10:04 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:04 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ed17b897-ac97-4c54-bd94-d19b378e455a tempest-VolumesTransfersV357Test-882718906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9768d102-7993-4229-9a8a-5ac3ba2d9085" returned: 0 in 0.500s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ed17b897-ac97-4c54-bd94-d19b378e455a tempest-VolumesTransfersV357Test-882718906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9768d102-7993-4229-9a8a-5ac3ba2d9085 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:04 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-35af9ff0-31e5-465e-886e-caff579c0d2a tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e" returned: 0 in 0.422s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:04 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-35af9ff0-31e5-465e-886e-caff579c0d2a tempest-VolumesDeleteCascade-2046481341 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e is being set with open permissions: ugo+rw
Nov 05 15:10:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-35af9ff0-31e5-465e-886e-caff579c0d2a tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:04 devstack sudo[95563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9768d102-7993-4229-9a8a-5ac3ba2d9085
Nov 05 15:10:04 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:04 devstack sudo[95564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e
Nov 05 15:10:04 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:05 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:05 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-35af9ff0-31e5-465e-886e-caff579c0d2a tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e" returned: 0 in 0.286s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ed17b897-ac97-4c54-bd94-d19b378e455a tempest-VolumesTransfersV357Test-882718906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9768d102-7993-4229-9a8a-5ac3ba2d9085" returned: 0 in 0.314s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-35af9ff0-31e5-465e-886e-caff579c0d2a tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.191s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ed17b897-ac97-4c54-bd94-d19b378e455a tempest-VolumesTransfersV357Test-882718906 None] Lock "cinder-quobyte-9768d102-7993-4229-9a8a-5ac3ba2d9085" released by "delete_volume" :: held 1.018s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:05 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-35af9ff0-31e5-465e-886e-caff579c0d2a tempest-VolumesDeleteCascade-2046481341 None] Create snapshot completed successfully
Nov 05 15:10:05 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-ed17b897-ac97-4c54-bd94-d19b378e455a tempest-VolumesTransfersV357Test-882718906 None] Created reservations ['7418f484-4927-4115-ad05-2212f2a8a3a4', '990b7f8c-9a6d-40dc-867e-1b65848ef644', 'f61569c4-dce8-44d5-879e-9fda96faa4b8', '68848a89-136e-4d6d-8617-6ec0e73da6de'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:10:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ed17b897-ac97-4c54-bd94-d19b378e455a tempest-VolumesTransfersV357Test-882718906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:10:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ed17b897-ac97-4c54-bd94-d19b378e455a tempest-VolumesTransfersV357Test-882718906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:10:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ed17b897-ac97-4c54-bd94-d19b378e455a tempest-VolumesTransfersV357Test-882718906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:10:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ed17b897-ac97-4c54-bd94-d19b378e455a tempest-VolumesTransfersV357Test-882718906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:10:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ed17b897-ac97-4c54-bd94-d19b378e455a tempest-VolumesTransfersV357Test-882718906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ed17b897-ac97-4c54-bd94-d19b378e455a tempest-VolumesTransfersV357Test-882718906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:05 devstack sudo[95608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:10:05 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:05 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ed17b897-ac97-4c54-bd94-d19b378e455a tempest-VolumesTransfersV357Test-882718906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.343s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:05 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-ed17b897-ac97-4c54-bd94-d19b378e455a tempest-VolumesTransfersV357Test-882718906 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:10:05 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ed17b897-ac97-4c54-bd94-d19b378e455a tempest-VolumesTransfersV357Test-882718906 None] Deleted volume successfully.
Nov 05 15:10:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ed17b897-ac97-4c54-bd94-d19b378e455a tempest-VolumesTransfersV357Test-882718906 None] Lock "cinder-9768d102-7993-4229-9a8a-5ac3ba2d9085-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "cinder-932fdb9a-be61-444c-a85b-8b847d966f5f-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-932fdb9a-be61-444c-a85b-8b847d966f5f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Performing cascade delete. {{(pid=87150) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 05 15:10:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "cinder-5186bdd2-1a11-42bf-bacc-c8e167a74ff2-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-5186bdd2-1a11-42bf-bacc-c8e167a74ff2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "cinder-quobyte-932fdb9a-be61-444c-a85b-8b847d966f5f" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-quobyte-932fdb9a-be61-444c-a85b-8b847d966f5f" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "cinder-quobyte-5186bdd2-1a11-42bf-bacc-c8e167a74ff2" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-quobyte-5186bdd2-1a11-42bf-bacc-c8e167a74ff2" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Deleting offline snapshot 5186bdd2-1a11-42bf-bacc-c8e167a74ff2 of volume 932fdb9a-be61-444c-a85b-8b847d966f5f {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:10:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] snapshot_file for this snap is: volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:10:06 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3e6047-47c4-4c43-b73e-54dd8478d941]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:06 devstack sudo[95639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2
Nov 05 15:10:06 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:07 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2" returned: 0 in 0.710s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-932fdb9a-be61-444c-a85b-8b847d966f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:10:07 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[080b1cff-0497-4f5f-9420-766dd80fae5d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:07 devstack sudo[95647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f
Nov 05 15:10:07 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:07 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f" returned: 0 in 0.592s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:08 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1504600e-2014-4583-bd74-547423f612fb]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:08 devstack sudo[95654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e
Nov 05 15:10:08 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:08 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e" returned: 0 in 0.615s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-932fdb9a-be61-444c-a85b-8b847d966f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:10:08 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6413a03-ddd9-47ed-a978-9ce4def93e0d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:08 devstack sudo[95660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2
Nov 05 15:10:08 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:09 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2" returned: 0 in 0.540s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-932fdb9a-be61-444c-a85b-8b847d966f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:10:09 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6533692d-96c8-49ac-84fe-4ee5f3ff1bc1]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:09 devstack sudo[95665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f
Nov 05 15:10:09 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:09 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f" returned: 0 in 0.673s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:09 devstack sudo[95670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2
Nov 05 15:10:09 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:10 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2" returned: 0 in 0.555s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:10 devstack sudo[95675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2
Nov 05 15:10:10 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:10 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.5186bdd2-1a11-42bf-bacc-c8e167a74ff2" returned: 0 in 0.409s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932fdb9a-be61-444c-a85b-8b847d966f5f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e -F qcow2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:10 devstack sudo[95678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932fdb9a-be61-444c-a85b-8b847d966f5f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e -F qcow2
Nov 05 15:10:10 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:11 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932fdb9a-be61-444c-a85b-8b847d966f5f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e -F qcow2" returned: 0 in 0.445s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-quobyte-5186bdd2-1a11-42bf-bacc-c8e167a74ff2" released by "_delete_snapshot" :: held 4.876s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-quobyte-932fdb9a-be61-444c-a85b-8b847d966f5f" released by "delete_snapshot" :: held 4.921s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:11 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Created reservations ['cfbfd2bc-819d-44be-915a-b23c33af4967', '04b35182-16ab-4adb-9fa2-49eda00e7b9a', 'df0810d6-db7e-407c-a371-1c75f220bb81', '93eae629-12ae-4c6c-9bef-484b8177a4b8'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:10:11 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Delete snapshot completed successfully.
Nov 05 15:10:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-5186bdd2-1a11-42bf-bacc-c8e167a74ff2-delete_snapshot" released by "delete_snapshot" :: held 5.210s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "cinder-7ce9ce78-3dcc-4e4e-aa87-84253575c39e-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-7ce9ce78-3dcc-4e4e-aa87-84253575c39e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "cinder-quobyte-932fdb9a-be61-444c-a85b-8b847d966f5f" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-quobyte-932fdb9a-be61-444c-a85b-8b847d966f5f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "cinder-quobyte-7ce9ce78-3dcc-4e4e-aa87-84253575c39e" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-quobyte-7ce9ce78-3dcc-4e4e-aa87-84253575c39e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Deleting offline snapshot 7ce9ce78-3dcc-4e4e-aa87-84253575c39e of volume 932fdb9a-be61-444c-a85b-8b847d966f5f {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:10:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] snapshot_file for this snap is: volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:10:11 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edcff92-f72f-4e21-8516-7422ad4fd650]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:11 devstack sudo[95683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e
Nov 05 15:10:11 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:12 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e" returned: 0 in 0.651s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-932fdb9a-be61-444c-a85b-8b847d966f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:10:12 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[386a8105-03c1-4728-aab3-926560be0788]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:12 devstack sudo[95688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f
Nov 05 15:10:12 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:12 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f" returned: 0 in 0.527s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:12 devstack sudo[95693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e
Nov 05 15:10:12 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:13 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e" returned: 0 in 0.467s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:13 devstack sudo[95699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e
Nov 05 15:10:13 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:13 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f.7ce9ce78-3dcc-4e4e-aa87-84253575c39e" returned: 0 in 0.465s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-quobyte-7ce9ce78-3dcc-4e4e-aa87-84253575c39e" released by "_delete_snapshot" :: held 2.263s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-quobyte-932fdb9a-be61-444c-a85b-8b847d966f5f" released by "delete_snapshot" :: held 2.298s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:14 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Created reservations ['ff726641-6a70-4b14-81d3-3bac875628f0', 'e7097e44-d4c3-457b-9c6e-05042bc879b8', 'c4df665d-a49b-44d8-bc39-2e559d2e4e48', '7acff07b-8c0d-4310-91fb-3a533f6c3966'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:10:14 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Delete snapshot completed successfully.
Nov 05 15:10:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-7ce9ce78-3dcc-4e4e-aa87-84253575c39e-delete_snapshot" released by "delete_snapshot" :: held 2.520s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Snapshots deleted, issuing volume delete {{(pid=87150) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 05 15:10:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "cinder-quobyte-932fdb9a-be61-444c-a85b-8b847d966f5f" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-quobyte-932fdb9a-be61-444c-a85b-8b847d966f5f" acquired by "delete_volume" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:14 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0977a0f7-555f-420e-a893-4b4a258ca7c3]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:14 devstack sudo[95702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f
Nov 05 15:10:14 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:14 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f" returned: 0 in 0.484s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:14 devstack sudo[95707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f
Nov 05 15:10:14 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:15 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-932fdb9a-be61-444c-a85b-8b847d966f5f" returned: 0 in 0.282s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-quobyte-932fdb9a-be61-444c-a85b-8b847d966f5f" released by "delete_volume" :: held 0.889s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:15 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Created reservations ['4c335542-e2eb-47d4-82da-27a54e996479', 'd444ce29-05f3-4fe8-87b5-f0d399360b24', '8dfc4eeb-b758-45d2-bf9f-8a7d5631403c', 'b005607e-4460-4721-aaee-bb9e078fc0f6'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:10:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:10:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:10:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:10:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:10:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:15 devstack sudo[95711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:10:15 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:15 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.406s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:15 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:10:15 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Deleted volume successfully.
Nov 05 15:10:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1dff8c5-da2f-4cad-9884-1890fe2712b1 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-932fdb9a-be61-444c-a85b-8b847d966f5f-delete_volume" released by "delete_volume" :: held 9.509s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:16 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:10:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Flow 'volume_create_manager' (f1c7fee1-bf68-453f-a91f-b37ec228577c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:10:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bba067-546d-4f70-9d8a-cc85619f4a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bba067-546d-4f70-9d8a-cc85619f4a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1376342394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86faf752-7a51-4d10-9467-7a64177dcdad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc1cb61ca05444db312ef6cfe24df4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:10:17Z,use_quota=True,user_id='223f2dcb86b14248afc22357e12c10b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86c9e64c-9ae0-436b-b47d-138dc053da8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86c9e64c-9ae0-436b-b47d-138dc053da8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0e888e-1366-45ed-bf55-becc0e4cd264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0e888e-1366-45ed-bf55-becc0e4cd264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86faf752-7a51-4d10-9467-7a64177dcdad', 'volume_name': 'volume-86faf752-7a51-4d10-9467-7a64177dcdad', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7828340-bdb8-4a6c-b1cf-91fd7e6eada0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7828340-bdb8-4a6c-b1cf-91fd7e6eada0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e703f48b-d454-4e69-a2ce-8155b14a81e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:17 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Volume 86faf752-7a51-4d10-9467-7a64177dcdad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86faf752-7a51-4d10-9467-7a64177dcdad', 'volume_size': 1}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1376342394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86faf752-7a51-4d10-9467-7a64177dcdad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc1cb61ca05444db312ef6cfe24df4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:10:17Z,use_quota=True,user_id='223f2dcb86b14248afc22357e12c10b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Creating volume 86faf752-7a51-4d10-9467-7a64177dcdad {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:10:17 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:17 devstack sudo[95750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad 1073741824
Nov 05 15:10:17 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Flow 'volume_create_manager' (24425046-c913-4b4d-a7ac-a71f07280f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91616792-6c3f-4e7a-b681-c8ecf06972bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91616792-6c3f-4e7a-b681-c8ecf06972bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-640309734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101fd451-12fe-4b5c-b3ae-3ae7da922dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8f5ebb98d548b8adbf4d6b4f9b3540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:10:17Z,use_quota=True,user_id='df70e76126de4480817f3875d82b3afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65292403-8f16-4a49-9ec1-57d5da9f2e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65292403-8f16-4a49-9ec1-57d5da9f2e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27191678-e68c-45c4-abec-8b0e9c7e90d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27191678-e68c-45c4-abec-8b0e9c7e90d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '101fd451-12fe-4b5c-b3ae-3ae7da922dc4', 'volume_name': 'volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9920ed2-eb5b-467e-99d5-99043b1ef12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9920ed2-eb5b-467e-99d5-99043b1ef12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df026a1-e937-4a9d-8357-278d34a2c43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:17 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Volume 101fd451-12fe-4b5c-b3ae-3ae7da922dc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4', 'volume_size': 1}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:10:17 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad 1073741824" returned: 0 in 0.764s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:17 devstack sudo[95757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad
Nov 05 15:10:17 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:18 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad" returned: 0 in 0.322s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:10:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.629s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:10:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-640309734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101fd451-12fe-4b5c-b3ae-3ae7da922dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8f5ebb98d548b8adbf4d6b4f9b3540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:10:17Z,use_quota=True,user_id='df70e76126de4480817f3875d82b3afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:10:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Creating volume 101fd451-12fe-4b5c-b3ae-3ae7da922dc4 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:10:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:10:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:10:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:10:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:10:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:10:18 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:10:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e703f48b-d454-4e69-a2ce-8155b14a81e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86faf752-7a51-4d10-9467-7a64177dcdad', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b628cd-50ba-43ff-a6f3-e499c8fc19f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:18 devstack sudo[95760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4 1073741824
Nov 05 15:10:18 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:18 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Volume volume-86faf752-7a51-4d10-9467-7a64177dcdad (86faf752-7a51-4d10-9467-7a64177dcdad): created successfully
Nov 05 15:10:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b628cd-50ba-43ff-a6f3-e499c8fc19f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Flow 'volume_create_manager' (f1c7fee1-bf68-453f-a91f-b37ec228577c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:10:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-69257121-226a-49f9-b0b6-72cb969d68fe tempest-VolumesDeleteCascade-2046481341 None] Created volume successfully.
Nov 05 15:10:18 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4 1073741824" returned: 0 in 0.508s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:18 devstack sudo[95767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4
Nov 05 15:10:18 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:19 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4" returned: 0 in 0.362s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:10:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df026a1-e937-4a9d-8357-278d34a2c43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba1d490-867a-464f-b85e-d114f94913b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c7f1e4ee-b42e-4fc4-bebd-eeba8eac01fe tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:10:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c7f1e4ee-b42e-4fc4-bebd-eeba8eac01fe tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:10:19 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Volume volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4 (101fd451-12fe-4b5c-b3ae-3ae7da922dc4): created successfully
Nov 05 15:10:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba1d490-867a-464f-b85e-d114f94913b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Flow 'volume_create_manager' (24425046-c913-4b4d-a7ac-a71f07280f35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:10:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c7f1e4ee-b42e-4fc4-bebd-eeba8eac01fe tempest-VolumesDeleteCascade-2046481341 None] Creating offline snapshot fac3ef78-9e01-483a-ae83-1844c4883157 of volume 86faf752-7a51-4d10-9467-7a64177dcdad {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:10:19 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-dddb985b-15f5-4cf6-b212-4f88c619da65 tempest-VolumesCloneTest-1142267886 None] Created volume successfully.
Nov 05 15:10:19 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[15912d7b-e2e3-49f1-81c6-0f8d2a457266]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c7f1e4ee-b42e-4fc4-bebd-eeba8eac01fe tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:19 devstack sudo[95774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad
Nov 05 15:10:19 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:19 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c7f1e4ee-b42e-4fc4-bebd-eeba8eac01fe tempest-VolumesDeleteCascade-2046481341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad" returned: 0 in 0.462s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c7f1e4ee-b42e-4fc4-bebd-eeba8eac01fe tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.fac3ef78-9e01-483a-ae83-1844c4883157 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:19 devstack sudo[95779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.fac3ef78-9e01-483a-ae83-1844c4883157 1G
Nov 05 15:10:19 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:20 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:10:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Flow 'volume_create_manager' (2d3bb811-1831-44e1-aaf1-65a72d90c0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:10:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d08558-8537-4df1-bc0d-1bdd0aececf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d08558-8537-4df1-bc0d-1bdd0aececf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-422273121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8396a394-a66d-453f-8ab0-a9d92754de54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8f5ebb98d548b8adbf4d6b4f9b3540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:10:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=101fd451-12fe-4b5c-b3ae-3ae7da922dc4,status='creating',terminated_at=None,updated_at=2026-11-05T14:10:20Z,use_quota=True,user_id='df70e76126de4480817f3875d82b3afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebbbed35-d0d9-4d76-8ff1-5a30f9609594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebbbed35-d0d9-4d76-8ff1-5a30f9609594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c47c0a62-4a79-4bcc-9e11-5fa56208a8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c47c0a62-4a79-4bcc-9e11-5fa56208a8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8396a394-a66d-453f-8ab0-a9d92754de54', 'volume_name': 'volume-8396a394-a66d-453f-8ab0-a9d92754de54', 'volume_size': 2, 'source_volid': '101fd451-12fe-4b5c-b3ae-3ae7da922dc4', 'source_volstatus': 'available'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836560f6-76d1-42fd-b2e5-97e2a8512ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:20 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836560f6-76d1-42fd-b2e5-97e2a8512ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c81fc66-55ea-469d-9555-c0855f615d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:20 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Volume 8396a394-a66d-453f-8ab0-a9d92754de54: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8396a394-a66d-453f-8ab0-a9d92754de54', 'volume_size': 2, 'source_volid': '101fd451-12fe-4b5c-b3ae-3ae7da922dc4', 'source_volstatus': 'available'}
Nov 05 15:10:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c7f1e4ee-b42e-4fc4-bebd-eeba8eac01fe tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.fac3ef78-9e01-483a-ae83-1844c4883157 1G" returned: 0 in 0.530s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c7f1e4ee-b42e-4fc4-bebd-eeba8eac01fe tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86faf752-7a51-4d10-9467-7a64177dcdad -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.fac3ef78-9e01-483a-ae83-1844c4883157 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:10:20 devstack sudo[95791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86faf752-7a51-4d10-9467-7a64177dcdad -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.fac3ef78-9e01-483a-ae83-1844c4883157
Nov 05 15:10:20 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:20 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c7f1e4ee-b42e-4fc4-bebd-eeba8eac01fe tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86faf752-7a51-4d10-9467-7a64177dcdad -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.fac3ef78-9e01-483a-ae83-1844c4883157" returned: 0 in 0.331s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:20 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-c7f1e4ee-b42e-4fc4-bebd-eeba8eac01fe tempest-VolumesDeleteCascade-2046481341 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.fac3ef78-9e01-483a-ae83-1844c4883157 is being set with open permissions: ugo+rw
Nov 05 15:10:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c7f1e4ee-b42e-4fc4-bebd-eeba8eac01fe tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.fac3ef78-9e01-483a-ae83-1844c4883157 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:20 devstack sudo[95797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.fac3ef78-9e01-483a-ae83-1844c4883157
Nov 05 15:10:20 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:20 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c7f1e4ee-b42e-4fc4-bebd-eeba8eac01fe tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.fac3ef78-9e01-483a-ae83-1844c4883157" returned: 0 in 0.256s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c7f1e4ee-b42e-4fc4-bebd-eeba8eac01fe tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:20 devstack sudo[95800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.info
Nov 05 15:10:20 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:21 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c7f1e4ee-b42e-4fc4-bebd-eeba8eac01fe tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.info" returned: 0 in 0.269s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:21 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-c7f1e4ee-b42e-4fc4-bebd-eeba8eac01fe tempest-VolumesDeleteCascade-2046481341 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.info is being set with open permissions: ugo+rw
Nov 05 15:10:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c7f1e4ee-b42e-4fc4-bebd-eeba8eac01fe tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:21 devstack sudo[95803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.info
Nov 05 15:10:21 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:21 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c7f1e4ee-b42e-4fc4-bebd-eeba8eac01fe tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.info" returned: 0 in 0.248s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c7f1e4ee-b42e-4fc4-bebd-eeba8eac01fe tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.229s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.148s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:10:21 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Cloning volume 101fd451-12fe-4b5c-b3ae-3ae7da922dc4 to volume 8396a394-a66d-453f-8ab0-a9d92754de54
Nov 05 15:10:21 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c7f1e4ee-b42e-4fc4-bebd-eeba8eac01fe tempest-VolumesDeleteCascade-2046481341 None] Create snapshot completed successfully
Nov 05 15:10:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Creating offline snapshot f2fc9c79-0c1c-400e-9b62-4a72fb052aa5 of volume 101fd451-12fe-4b5c-b3ae-3ae7da922dc4 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:10:21 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[455b6987-b876-4b17-9b67-53ce0f8f8e6f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:21 devstack sudo[95806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4
Nov 05 15:10:21 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:21 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4" returned: 0 in 0.398s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.f2fc9c79-0c1c-400e-9b62-4a72fb052aa5 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:21 devstack sudo[95811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.f2fc9c79-0c1c-400e-9b62-4a72fb052aa5 1G
Nov 05 15:10:21 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:22 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.f2fc9c79-0c1c-400e-9b62-4a72fb052aa5 1G" returned: 0 in 0.453s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.f2fc9c79-0c1c-400e-9b62-4a72fb052aa5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:22 devstack sudo[95817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.f2fc9c79-0c1c-400e-9b62-4a72fb052aa5
Nov 05 15:10:22 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:22 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.f2fc9c79-0c1c-400e-9b62-4a72fb052aa5" returned: 0 in 0.375s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:22 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.f2fc9c79-0c1c-400e-9b62-4a72fb052aa5 is being set with open permissions: ugo+rw
Nov 05 15:10:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.f2fc9c79-0c1c-400e-9b62-4a72fb052aa5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:22 devstack sudo[95822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.f2fc9c79-0c1c-400e-9b62-4a72fb052aa5
Nov 05 15:10:22 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:22 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Flow 'volume_create_manager' (273eb0cd-d15f-477e-ab17-ade1fcc13181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2e7b50-3534-4fab-94c6-8bdea4f5c37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:23 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2e7b50-3534-4fab-94c6-8bdea4f5c37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1250011033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af16f5a-f180-4ede-9e84-89a3bcf7b4a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc1cb61ca05444db312ef6cfe24df4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fac3ef78-9e01-483a-ae83-1844c4883157,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:10:23Z,use_quota=True,user_id='223f2dcb86b14248afc22357e12c10b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3777ed3-544c-45e1-ab50-16ce14259ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3777ed3-544c-45e1-ab50-16ce14259ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7acd70ef-2f0c-4b58-8fde-23df2072a993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7acd70ef-2f0c-4b58-8fde-23df2072a993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6af16f5a-f180-4ede-9e84-89a3bcf7b4a0', 'volume_name': 'volume-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0', 'volume_size': 1, 'snapshot_id': 'fac3ef78-9e01-483a-ae83-1844c4883157'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fde7039-fe00-443c-a0ae-d699b6e210a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fde7039-fe00-443c-a0ae-d699b6e210a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef23e9bf-6f77-45d1-871e-684fcdbd84bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:23 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Volume 6af16f5a-f180-4ede-9e84-89a3bcf7b4a0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0', 'volume_size': 1, 'snapshot_id': 'fac3ef78-9e01-483a-ae83-1844c4883157'}
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.f2fc9c79-0c1c-400e-9b62-4a72fb052aa5" returned: 0 in 0.370s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:23 devstack sudo[95825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.info
Nov 05 15:10:23 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:23 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.info" returned: 0 in 0.261s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:23 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.info is being set with open permissions: ugo+rw
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:23 devstack sudo[95828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.info
Nov 05 15:10:23 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:23 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.info" returned: 0 in 0.242s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Acquiring lock "cinder-quobyte-8396a394-a66d-453f-8ab0-a9d92754de54" by "_copy_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Lock "cinder-quobyte-8396a394-a66d-453f-8ab0-a9d92754de54" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] snapshot: f2fc9c79-0c1c-400e-9b62-4a72fb052aa5, volume: 8396a394-a66d-453f-8ab0-a9d92754de54,  {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cdb89a-a5b3-466d-9d44-8b4d7562a032]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.f2fc9c79-0c1c-400e-9b62-4a72fb052aa5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:23 devstack sudo[95831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.f2fc9c79-0c1c-400e-9b62-4a72fb052aa5
Nov 05 15:10:23 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:24 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.f2fc9c79-0c1c-400e-9b62-4a72fb052aa5" returned: 0 in 0.455s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:10:24 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd85403-2f3e-4980-a1db-ab9f15eda5b9]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:24 devstack sudo[95836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4
Nov 05 15:10:24 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:24 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4" returned: 0 in 0.413s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4 {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 15:10:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Creating direct copy from snapshot {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 15:10:24 devstack cinder-volume[87150]: DEBUG cinder.utils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Path /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8396a394-a66d-453f-8ab0-a9d92754de54 not found in is_blk_device check {{(pid=87150) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 15:10:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8396a394-a66d-453f-8ab0-a9d92754de54 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:24 devstack sudo[95841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8396a394-a66d-453f-8ab0-a9d92754de54
Nov 05 15:10:24 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:34 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8396a394-a66d-453f-8ab0-a9d92754de54" returned: 0 in 9.860s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:34 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Image conversion details: src /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4, size 1024.00 MB, duration 9.86 sec, destination /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8396a394-a66d-453f-8ab0-a9d92754de54 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:10:34 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Converted 1024.00 MB image at 103.84 MB/s
Nov 05 15:10:34 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8396a394-a66d-453f-8ab0-a9d92754de54 is being set with open permissions: ugo+rw
Nov 05 15:10:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8396a394-a66d-453f-8ab0-a9d92754de54 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:34 devstack sudo[95896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8396a394-a66d-453f-8ab0-a9d92754de54
Nov 05 15:10:34 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:34 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8396a394-a66d-453f-8ab0-a9d92754de54" returned: 0 in 0.287s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Lock "cinder-quobyte-8396a394-a66d-453f-8ab0-a9d92754de54" released by "_copy_volume_from_snapshot" :: held 11.096s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Acquiring lock "cinder-quobyte-f2fc9c79-0c1c-400e-9b62-4a72fb052aa5" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Lock "cinder-quobyte-f2fc9c79-0c1c-400e-9b62-4a72fb052aa5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Deleting offline snapshot f2fc9c79-0c1c-400e-9b62-4a72fb052aa5 of volume 101fd451-12fe-4b5c-b3ae-3ae7da922dc4 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:10:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] snapshot_file for this snap is: volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.f2fc9c79-0c1c-400e-9b62-4a72fb052aa5 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:10:34 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab365ff-f971-46ea-b9dd-643a488ae493]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.f2fc9c79-0c1c-400e-9b62-4a72fb052aa5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:34 devstack sudo[95899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.f2fc9c79-0c1c-400e-9b62-4a72fb052aa5
Nov 05 15:10:34 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:35 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.f2fc9c79-0c1c-400e-9b62-4a72fb052aa5" returned: 0 in 0.375s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:10:35 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f668367-8bee-4e00-b54b-e4a45e288099]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:35 devstack sudo[95906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4
Nov 05 15:10:35 devstack sudo[95906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:35 devstack sudo[95906]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4" returned: 0 in 0.660s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.f2fc9c79-0c1c-400e-9b62-4a72fb052aa5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:35 devstack sudo[95912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.f2fc9c79-0c1c-400e-9b62-4a72fb052aa5
Nov 05 15:10:35 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:36 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.f2fc9c79-0c1c-400e-9b62-4a72fb052aa5" returned: 0 in 0.463s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.f2fc9c79-0c1c-400e-9b62-4a72fb052aa5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:36 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=78,cinder:SELECT=64,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:10:36 devstack sudo[95926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.f2fc9c79-0c1c-400e-9b62-4a72fb052aa5
Nov 05 15:10:36 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:36 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4.f2fc9c79-0c1c-400e-9b62-4a72fb052aa5" returned: 0 in 0.401s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Lock "cinder-quobyte-f2fc9c79-0c1c-400e-9b62-4a72fb052aa5" released by "_delete_snapshot" :: held 2.050s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.465s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 13.787s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:10:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "cinder-quobyte-fac3ef78-9e01-483a-ae83-1844c4883157-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0" by "_create_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c81fc66-55ea-469d-9555-c0855f615d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8396a394-a66d-453f-8ab0-a9d92754de54', 'volume_size': 2, 'source_volid': '101fd451-12fe-4b5c-b3ae-3ae7da922dc4', 'source_volstatus': 'available'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c83f132-c138-446e-8a04-224181f65ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-quobyte-fac3ef78-9e01-483a-ae83-1844c4883157-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Creating volume 6af16f5a-f180-4ede-9e84-89a3bcf7b4a0 from snapshot fac3ef78-9e01-483a-ae83-1844c4883157 {{(pid=87150) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 15:10:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:10:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:10:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:10:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:10:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:10:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "cinder-quobyte-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0" by "_copy_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:36 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Volume volume-8396a394-a66d-453f-8ab0-a9d92754de54 (8396a394-a66d-453f-8ab0-a9d92754de54): created successfully
Nov 05 15:10:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c83f132-c138-446e-8a04-224181f65ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Flow 'volume_create_manager' (2d3bb811-1831-44e1-aaf1-65a72d90c0a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:10:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-quobyte-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] snapshot: fac3ef78-9e01-483a-ae83-1844c4883157, volume: 6af16f5a-f180-4ede-9e84-89a3bcf7b4a0,  {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 15:10:37 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6e999991-bc88-41f7-80b4-f1a589cf5cd5 tempest-VolumesCloneTest-1142267886 None] Created volume successfully.
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3981b722-ea35-4c62-8351-b566b2ef68a3]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.fac3ef78-9e01-483a-ae83-1844c4883157 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-03c84f85-0dfe-4248-97f9-668cc93a47cb tempest-AttachVolumeShelveTestJSON-1011516400 None] Acquiring lock "cinder-0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-03c84f85-0dfe-4248-97f9-668cc93a47cb tempest-AttachVolumeShelveTestJSON-1011516400 None] Lock "cinder-0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-03c84f85-0dfe-4248-97f9-668cc93a47cb tempest-AttachVolumeShelveTestJSON-1011516400 None] Acquiring lock "cinder-quobyte-0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:37 devstack sudo[95937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.fac3ef78-9e01-483a-ae83-1844c4883157
Nov 05 15:10:37 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-03c84f85-0dfe-4248-97f9-668cc93a47cb tempest-AttachVolumeShelveTestJSON-1011516400 None] Lock "cinder-quobyte-0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c962d4-a6b6-4ac4-b7e5-feb6fbaa9abf]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-03c84f85-0dfe-4248-97f9-668cc93a47cb tempest-AttachVolumeShelveTestJSON-1011516400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:37 devstack sudo[95939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3
Nov 05 15:10:37 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:37 devstack sudo[95940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:10:37 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:37 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.fac3ef78-9e01-483a-ae83-1844c4883157" returned: 0 in 0.438s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86faf752-7a51-4d10-9467-7a64177dcdad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2515c0-97b4-4d9e-870c-77d934b4ac67]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:37 devstack sudo[95947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad
Nov 05 15:10:37 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:37 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.310s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread info: [<_MainThread(MainThread, started 136317437956224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136317326340928)>, <Thread(Thread-3 (stat_writer), started daemon 136317326487936)>, <Thread(Rabbit-heartbeat, started daemon 136317321464000)>, <Thread(Thread-5 (_runner), started daemon 136317321550592)>, <Thread(Thread-7 (_runner), started daemon 136317321658496)>, <Thread(fd_logger, started daemon 136317319612992)>, <Thread(privsep_reader, started daemon 136317319622400)>, <Thread(tpool_thread_0, started daemon 136317310928576)>, <Thread(tpool_thread_1, started daemon 136317302535872)>, <Thread(tpool_thread_2, started daemon 136317294143168)>, <Thread(tpool_thread_3, started daemon 136317285750464)>, <Thread(tpool_thread_4, started daemon 136317277357760)>, <Thread(tpool_thread_5, started daemon 136317268965056)>, <Thread(tpool_thread_6, started daemon 136317260572352)>, <Thread(tpool_thread_7, started daemon 136317252179648)>, <Thread(tpool_thread_8, started daemon 136317243786944)>, <Thread(tpool_thread_9, started daemon 136317235394240)>, <Thread(tpool_thread_10, started daemon 136317227001536)>, <Thread(tpool_thread_11, started daemon 136317218608832)>, <Thread(tpool_thread_12, started daemon 136317210216128)>, <Thread(tpool_thread_13, started daemon 136317201807040)>, <Thread(tpool_thread_14, started daemon 136317193397952)>, <Thread(tpool_thread_15, started daemon 136317184988864)>, <Thread(tpool_thread_16, started daemon 136317176579776)>, <Thread(tpool_thread_17, started daemon 136317168170688)>, <Thread(tpool_thread_18, started daemon 136317159761600)>, <Thread(tpool_thread_19, started daemon 136317151352512)>] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 15:10:37 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-03c84f85-0dfe-4248-97f9-668cc93a47cb tempest-AttachVolumeShelveTestJSON-1011516400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3" returned: 0 in 0.464s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-03c84f85-0dfe-4248-97f9-668cc93a47cb tempest-AttachVolumeShelveTestJSON-1011516400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:37 devstack sudo[95954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3
Nov 05 15:10:37 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:37 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad" returned: 0 in 0.459s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 15:10:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Creating direct copy from snapshot {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 15:10:38 devstack cinder-volume[87150]: DEBUG cinder.utils [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Path /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0 not found in is_blk_device check {{(pid=87150) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 15:10:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:38 devstack sudo[95961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0
Nov 05 15:10:38 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:38 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-03c84f85-0dfe-4248-97f9-668cc93a47cb tempest-AttachVolumeShelveTestJSON-1011516400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3" returned: 0 in 0.331s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-03c84f85-0dfe-4248-97f9-668cc93a47cb tempest-AttachVolumeShelveTestJSON-1011516400 None] Lock "cinder-quobyte-0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3" released by "delete_volume" :: held 0.859s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:38 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-03c84f85-0dfe-4248-97f9-668cc93a47cb tempest-AttachVolumeShelveTestJSON-1011516400 None] Created reservations ['9ef9bae1-1952-40ba-91de-35ff1532405e', 'b4dcda0c-98d9-44b2-bd85-9563759b47ea', '87b1edf6-615e-4d94-91a6-7fa981b6875b', '8e2bcdaa-1e41-496c-9d64-cf53cc2ccde6'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:10:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-03c84f85-0dfe-4248-97f9-668cc93a47cb tempest-AttachVolumeShelveTestJSON-1011516400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:10:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-03c84f85-0dfe-4248-97f9-668cc93a47cb tempest-AttachVolumeShelveTestJSON-1011516400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:10:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-03c84f85-0dfe-4248-97f9-668cc93a47cb tempest-AttachVolumeShelveTestJSON-1011516400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:10:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-03c84f85-0dfe-4248-97f9-668cc93a47cb tempest-AttachVolumeShelveTestJSON-1011516400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:10:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-03c84f85-0dfe-4248-97f9-668cc93a47cb tempest-AttachVolumeShelveTestJSON-1011516400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-03c84f85-0dfe-4248-97f9-668cc93a47cb tempest-AttachVolumeShelveTestJSON-1011516400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:38 devstack sudo[95963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:10:38 devstack sudo[95963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fac95caa-051b-4ca5-ab16-d78aa70ddffa tempest-VolumesCloneTest-1142267886 None] Acquiring lock "cinder-8396a394-a66d-453f-8ab0-a9d92754de54-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fac95caa-051b-4ca5-ab16-d78aa70ddffa tempest-VolumesCloneTest-1142267886 None] Lock "cinder-8396a394-a66d-453f-8ab0-a9d92754de54-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fac95caa-051b-4ca5-ab16-d78aa70ddffa tempest-VolumesCloneTest-1142267886 None] Acquiring lock "cinder-quobyte-8396a394-a66d-453f-8ab0-a9d92754de54" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fac95caa-051b-4ca5-ab16-d78aa70ddffa tempest-VolumesCloneTest-1142267886 None] Lock "cinder-quobyte-8396a394-a66d-453f-8ab0-a9d92754de54" acquired by "delete_volume" :: waited 0.038s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:38 devstack sudo[95963]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-03c84f85-0dfe-4248-97f9-668cc93a47cb tempest-AttachVolumeShelveTestJSON-1011516400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.471s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:38 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-03c84f85-0dfe-4248-97f9-668cc93a47cb tempest-AttachVolumeShelveTestJSON-1011516400 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:10:38 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-03c84f85-0dfe-4248-97f9-668cc93a47cb tempest-AttachVolumeShelveTestJSON-1011516400 None] Deleted volume successfully.
Nov 05 15:10:38 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb939d8-93ed-43ad-874f-63476142d796]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fac95caa-051b-4ca5-ab16-d78aa70ddffa tempest-VolumesCloneTest-1142267886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8396a394-a66d-453f-8ab0-a9d92754de54 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-03c84f85-0dfe-4248-97f9-668cc93a47cb tempest-AttachVolumeShelveTestJSON-1011516400 None] Lock "cinder-0a1ecbe4-1d42-427c-8f09-6f1d28f70ad3-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:38 devstack sudo[95975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8396a394-a66d-453f-8ab0-a9d92754de54
Nov 05 15:10:38 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:40 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fac95caa-051b-4ca5-ab16-d78aa70ddffa tempest-VolumesCloneTest-1142267886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8396a394-a66d-453f-8ab0-a9d92754de54" returned: 0 in 1.369s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fac95caa-051b-4ca5-ab16-d78aa70ddffa tempest-VolumesCloneTest-1142267886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8396a394-a66d-453f-8ab0-a9d92754de54 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:40 devstack sudo[96038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8396a394-a66d-453f-8ab0-a9d92754de54
Nov 05 15:10:40 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:40 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fac95caa-051b-4ca5-ab16-d78aa70ddffa tempest-VolumesCloneTest-1142267886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8396a394-a66d-453f-8ab0-a9d92754de54" returned: 0 in 0.825s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fac95caa-051b-4ca5-ab16-d78aa70ddffa tempest-VolumesCloneTest-1142267886 None] Lock "cinder-quobyte-8396a394-a66d-453f-8ab0-a9d92754de54" released by "delete_volume" :: held 2.290s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:41 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=77,cinder:INSERT=20,cinder:UPDATE=88,cinder:DELETE=8 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:10:41 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-fac95caa-051b-4ca5-ab16-d78aa70ddffa tempest-VolumesCloneTest-1142267886 None] Created reservations ['a9f152ae-0390-47b7-8c76-5a1896b96492', 'cda4af5d-fc23-4297-a885-3933ec29d219', '6f1c1384-0667-4b82-8cc4-50b76d03ece3', 'ef8163de-96ad-4bfe-a93f-a9365cfb4c63'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:10:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fac95caa-051b-4ca5-ab16-d78aa70ddffa tempest-VolumesCloneTest-1142267886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:10:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fac95caa-051b-4ca5-ab16-d78aa70ddffa tempest-VolumesCloneTest-1142267886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:10:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fac95caa-051b-4ca5-ab16-d78aa70ddffa tempest-VolumesCloneTest-1142267886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:10:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fac95caa-051b-4ca5-ab16-d78aa70ddffa tempest-VolumesCloneTest-1142267886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:10:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fac95caa-051b-4ca5-ab16-d78aa70ddffa tempest-VolumesCloneTest-1142267886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fac95caa-051b-4ca5-ab16-d78aa70ddffa tempest-VolumesCloneTest-1142267886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:41 devstack sudo[96056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:10:41 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:42 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fac95caa-051b-4ca5-ab16-d78aa70ddffa tempest-VolumesCloneTest-1142267886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.502s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:42 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-fac95caa-051b-4ca5-ab16-d78aa70ddffa tempest-VolumesCloneTest-1142267886 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:10:42 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-fac95caa-051b-4ca5-ab16-d78aa70ddffa tempest-VolumesCloneTest-1142267886 None] Deleted volume successfully.
Nov 05 15:10:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fac95caa-051b-4ca5-ab16-d78aa70ddffa tempest-VolumesCloneTest-1142267886 None] Lock "cinder-8396a394-a66d-453f-8ab0-a9d92754de54-delete_volume" released by "delete_volume" :: held 3.573s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6f40864c-050d-400a-9a06-a391dc3da49d tempest-VolumesCloneTest-1142267886 None] Acquiring lock "cinder-101fd451-12fe-4b5c-b3ae-3ae7da922dc4-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6f40864c-050d-400a-9a06-a391dc3da49d tempest-VolumesCloneTest-1142267886 None] Lock "cinder-101fd451-12fe-4b5c-b3ae-3ae7da922dc4-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6f40864c-050d-400a-9a06-a391dc3da49d tempest-VolumesCloneTest-1142267886 None] Acquiring lock "cinder-quobyte-101fd451-12fe-4b5c-b3ae-3ae7da922dc4" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6f40864c-050d-400a-9a06-a391dc3da49d tempest-VolumesCloneTest-1142267886 None] Lock "cinder-quobyte-101fd451-12fe-4b5c-b3ae-3ae7da922dc4" acquired by "delete_volume" :: waited 0.050s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:42 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7120f584-810c-41f1-a16d-0437825bfc14]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6f40864c-050d-400a-9a06-a391dc3da49d tempest-VolumesCloneTest-1142267886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:43 devstack sudo[96060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4
Nov 05 15:10:43 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:44 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6f40864c-050d-400a-9a06-a391dc3da49d tempest-VolumesCloneTest-1142267886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4" returned: 0 in 1.242s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6f40864c-050d-400a-9a06-a391dc3da49d tempest-VolumesCloneTest-1142267886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:44 devstack sudo[96066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4
Nov 05 15:10:44 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:45 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:10:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Flow 'volume_create_manager' (6a8c2123-9e67-4a52-957d-51691be85844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:10:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b55c2bc-1708-4af3-a9de-b08d74d52024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b55c2bc-1708-4af3-a9de-b08d74d52024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-158382552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4148da727d46b0b38bbe7e12700ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:10:45Z,use_quota=True,user_id='850eca358ca4492ab97a3790837e0e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f09a98-e536-426d-ae3b-00ffdccb7ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f09a98-e536-426d-ae3b-00ffdccb7ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (869b93a1-a8bd-452c-80e6-e6cdd160f043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (869b93a1-a8bd-452c-80e6-e6cdd160f043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6', 'volume_name': 'volume-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d4aec4-aaaf-42d4-b01b-717bdb460921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d4aec4-aaaf-42d4-b01b-717bdb460921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:45 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec260c1-cefb-41d8-8423-4fc3976d4867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:45 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Volume ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6', 'volume_size': 1}
Nov 05 15:10:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:10:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6f40864c-050d-400a-9a06-a391dc3da49d tempest-VolumesCloneTest-1142267886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-101fd451-12fe-4b5c-b3ae-3ae7da922dc4" returned: 0 in 1.185s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6f40864c-050d-400a-9a06-a391dc3da49d tempest-VolumesCloneTest-1142267886 None] Lock "cinder-quobyte-101fd451-12fe-4b5c-b3ae-3ae7da922dc4" released by "delete_volume" :: held 2.633s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:45 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-6f40864c-050d-400a-9a06-a391dc3da49d tempest-VolumesCloneTest-1142267886 None] Created reservations ['f50e20fe-4cee-474b-99b7-13ae40883c0f', 'a240ac34-1719-41ca-a48f-d025ebdb5db8', '52adba10-d41c-474a-9f6a-1e39b1c1d123', 'b7183fb8-2b7b-4d2c-bb4d-72398e09087e'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:10:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6f40864c-050d-400a-9a06-a391dc3da49d tempest-VolumesCloneTest-1142267886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:10:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6f40864c-050d-400a-9a06-a391dc3da49d tempest-VolumesCloneTest-1142267886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:10:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6f40864c-050d-400a-9a06-a391dc3da49d tempest-VolumesCloneTest-1142267886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:10:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6f40864c-050d-400a-9a06-a391dc3da49d tempest-VolumesCloneTest-1142267886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:10:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6f40864c-050d-400a-9a06-a391dc3da49d tempest-VolumesCloneTest-1142267886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6f40864c-050d-400a-9a06-a391dc3da49d tempest-VolumesCloneTest-1142267886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:46 devstack sudo[96069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:10:46 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:46 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6f40864c-050d-400a-9a06-a391dc3da49d tempest-VolumesCloneTest-1142267886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.883s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:46 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-6f40864c-050d-400a-9a06-a391dc3da49d tempest-VolumesCloneTest-1142267886 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:10:46 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6f40864c-050d-400a-9a06-a391dc3da49d tempest-VolumesCloneTest-1142267886 None] Deleted volume successfully.
Nov 05 15:10:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6f40864c-050d-400a-9a06-a391dc3da49d tempest-VolumesCloneTest-1142267886 None] Lock "cinder-101fd451-12fe-4b5c-b3ae-3ae7da922dc4-delete_volume" released by "delete_volume" :: held 4.296s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:50 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0" returned: 0 in 12.403s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:50 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Image conversion details: src /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad, size 1024.00 MB, duration 12.40 sec, destination /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:10:50 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Converted 1024.00 MB image at 82.55 MB/s
Nov 05 15:10:50 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0 is being set with open permissions: ugo+rw
Nov 05 15:10:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:50 devstack sudo[96075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0
Nov 05 15:10:50 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:50 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0" returned: 0 in 0.368s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-quobyte-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0" released by "_copy_volume_from_snapshot" :: held 13.814s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-quobyte-fac3ef78-9e01-483a-ae83-1844c4883157-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0" released by "_create_volume_from_snapshot" :: held 13.919s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.953s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.459s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:10:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-158382552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4148da727d46b0b38bbe7e12700ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:10:45Z,use_quota=True,user_id='850eca358ca4492ab97a3790837e0e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:10:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Creating volume ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:10:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:10:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:10:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:10:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:10:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:10:50 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:10:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:50 devstack sudo[96079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6 1073741824
Nov 05 15:10:50 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef23e9bf-6f77-45d1-871e-684fcdbd84bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0', 'volume_size': 1, 'snapshot_id': 'fac3ef78-9e01-483a-ae83-1844c4883157'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da46210-f802-4de6-8b15-1371cf79e1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:51 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Volume volume-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0 (6af16f5a-f180-4ede-9e84-89a3bcf7b4a0): created successfully
Nov 05 15:10:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da46210-f802-4de6-8b15-1371cf79e1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Flow 'volume_create_manager' (273eb0cd-d15f-477e-ab17-ade1fcc13181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:10:51 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5a47e198-4cae-4145-86ee-bc6e0f17710c tempest-VolumesDeleteCascade-2046481341 None] Created volume successfully.
Nov 05 15:10:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "cinder-86faf752-7a51-4d10-9467-7a64177dcdad-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-86faf752-7a51-4d10-9467-7a64177dcdad-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Performing cascade delete. {{(pid=87150) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 05 15:10:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "cinder-fac3ef78-9e01-483a-ae83-1844c4883157-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-fac3ef78-9e01-483a-ae83-1844c4883157-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "cinder-quobyte-86faf752-7a51-4d10-9467-7a64177dcdad" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-quobyte-86faf752-7a51-4d10-9467-7a64177dcdad" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "cinder-quobyte-fac3ef78-9e01-483a-ae83-1844c4883157" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-quobyte-fac3ef78-9e01-483a-ae83-1844c4883157" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Deleting offline snapshot fac3ef78-9e01-483a-ae83-1844c4883157 of volume 86faf752-7a51-4d10-9467-7a64177dcdad {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:10:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] snapshot_file for this snap is: volume-86faf752-7a51-4d10-9467-7a64177dcdad.fac3ef78-9e01-483a-ae83-1844c4883157 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:10:51 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69c9ee8-1628-4faf-a4ac-373c9deb73f8]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.fac3ef78-9e01-483a-ae83-1844c4883157 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:51 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6 1073741824" returned: 0 in 0.841s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:51 devstack sudo[96084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.fac3ef78-9e01-483a-ae83-1844c4883157
Nov 05 15:10:51 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:51 devstack sudo[96086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6
Nov 05 15:10:51 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:52 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.fac3ef78-9e01-483a-ae83-1844c4883157" returned: 0 in 0.500s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86faf752-7a51-4d10-9467-7a64177dcdad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:10:52 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcfe648-57e8-4506-a505-4510d3c353f6]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:52 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6" returned: 0 in 0.443s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:10:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec260c1-cefb-41d8-8423-4fc3976d4867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7597113a-1af1-410b-abd8-d8186ec3c7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:10:52 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Volume volume-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6 (ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6): created successfully
Nov 05 15:10:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7597113a-1af1-410b-abd8-d8186ec3c7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:10:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Flow 'volume_create_manager' (6a8c2123-9e67-4a52-957d-51691be85844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:10:52 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1c48fbde-eace-4647-b550-f970484fc7cb tempest-VolumesActionsTest-1533429368 None] Created volume successfully.
Nov 05 15:10:52 devstack sudo[96092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad
Nov 05 15:10:52 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:53 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5cb2d449-a840-42a1-99a9-ab510e52e7d9 tempest-VolumesActionsTest-1533429368 None] Acquiring lock "cinder-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6" by "attach_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad" returned: 0 in 0.838s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.fac3ef78-9e01-483a-ae83-1844c4883157 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:53 devstack sudo[96097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.fac3ef78-9e01-483a-ae83-1844c4883157
Nov 05 15:10:53 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5cb2d449-a840-42a1-99a9-ab510e52e7d9 tempest-VolumesActionsTest-1533429368 None] Lock "cinder-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6" acquired by "attach_volume" :: waited 0.072s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:53 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5cb2d449-a840-42a1-99a9-ab510e52e7d9 tempest-VolumesActionsTest-1533429368 None] Attaching volume ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6 to instance 6f568895-2658-45c5-a8ca-8d1fe66fe26e at mountpoint /dev/vdb on host None.
Nov 05 15:10:53 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5cb2d449-a840-42a1-99a9-ab510e52e7d9 tempest-VolumesActionsTest-1533429368 None] Attach volume completed successfully.
Nov 05 15:10:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5cb2d449-a840-42a1-99a9-ab510e52e7d9 tempest-VolumesActionsTest-1533429368 None] Lock "cinder-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6" released by "attach_volume" :: held 0.253s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:53 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.fac3ef78-9e01-483a-ae83-1844c4883157" returned: 0 in 0.683s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.fac3ef78-9e01-483a-ae83-1844c4883157 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:53 devstack sudo[96119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.fac3ef78-9e01-483a-ae83-1844c4883157
Nov 05 15:10:53 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:54 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad.fac3ef78-9e01-483a-ae83-1844c4883157" returned: 0 in 0.465s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-quobyte-fac3ef78-9e01-483a-ae83-1844c4883157" released by "_delete_snapshot" :: held 2.665s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-quobyte-86faf752-7a51-4d10-9467-7a64177dcdad" released by "delete_snapshot" :: held 2.720s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:54 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Created reservations ['ba7d2343-2341-46d1-9ad4-2c7e563ded97', '855b3848-89c7-4c07-a5f9-c5418fe15793', '3272082c-e1b9-4350-97d9-9a76df0479f7', '3bcc9c78-f2af-4ee3-b7be-d39dcc99f0f4'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:10:54 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Delete snapshot completed successfully.
Nov 05 15:10:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-fac3ef78-9e01-483a-ae83-1844c4883157-delete_snapshot" released by "delete_snapshot" :: held 2.957s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Snapshots deleted, issuing volume delete {{(pid=87150) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 05 15:10:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "cinder-quobyte-86faf752-7a51-4d10-9467-7a64177dcdad" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-quobyte-86faf752-7a51-4d10-9467-7a64177dcdad" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:54 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e913dfb1-e950-4b82-bbfc-9ec39c55e563]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:54 devstack sudo[96122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad
Nov 05 15:10:54 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:54 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-23587824-dd6d-417f-afed-9f6a072b0cc5 tempest-VolumesActionsTest-2062653536 None] Terminate volume connection completed successfully.
Nov 05 15:10:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-23587824-dd6d-417f-afed-9f6a072b0cc5 tempest-VolumesActionsTest-2062653536 None] Acquiring lock "cinder-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6-detach_volume" by "detach_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-23587824-dd6d-417f-afed-9f6a072b0cc5 tempest-VolumesActionsTest-2062653536 None] Lock "cinder-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:55 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-23587824-dd6d-417f-afed-9f6a072b0cc5 tempest-VolumesActionsTest-2062653536 None] Detaching volume ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6 from instance 6f568895-2658-45c5-a8ca-8d1fe66fe26e.
Nov 05 15:10:55 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-23587824-dd6d-417f-afed-9f6a072b0cc5 tempest-VolumesActionsTest-2062653536 None] Detach volume completed successfully.
Nov 05 15:10:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-23587824-dd6d-417f-afed-9f6a072b0cc5 tempest-VolumesActionsTest-2062653536 None] Lock "cinder-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6-detach_volume" released by "detach_volume" :: held 0.108s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:55 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad" returned: 0 in 0.583s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:55 devstack sudo[96127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad
Nov 05 15:10:55 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-94b7250d-705f-4112-a38c-6635f811cab7 tempest-VolumesActionsTest-1533429368 None] Acquiring lock "cinder-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6-detach_volume" by "detach_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-94b7250d-705f-4112-a38c-6635f811cab7 tempest-VolumesActionsTest-1533429368 None] Lock "cinder-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:55 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-94b7250d-705f-4112-a38c-6635f811cab7 tempest-VolumesActionsTest-1533429368 None] Volume detach called, but volume not attached.
Nov 05 15:10:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-94b7250d-705f-4112-a38c-6635f811cab7 tempest-VolumesActionsTest-1533429368 None] Lock "cinder-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6-detach_volume" released by "detach_volume" :: held 0.030s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:55 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-86faf752-7a51-4d10-9467-7a64177dcdad" returned: 0 in 0.359s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-quobyte-86faf752-7a51-4d10-9467-7a64177dcdad" released by "delete_volume" :: held 1.032s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:55 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Created reservations ['5f11fc62-2bfe-40c6-9f01-7bcd56deaa80', 'c1be7a4b-5cdd-4d5b-9684-1d842c793e3a', '0a331955-ee11-4763-b05e-0c451bf57d73', '2b5eb568-01f4-4221-8e5f-2033057825e0'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:10:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0104e491-fe79-4956-bafa-c05cb72f014c tempest-VolumesActionsTest-1533429368 None] Acquiring lock "cinder-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0104e491-fe79-4956-bafa-c05cb72f014c tempest-VolumesActionsTest-1533429368 None] Lock "cinder-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:10:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:10:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:10:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:10:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:55 devstack sudo[96130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:10:55 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0104e491-fe79-4956-bafa-c05cb72f014c tempest-VolumesActionsTest-1533429368 None] Acquiring lock "cinder-quobyte-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0104e491-fe79-4956-bafa-c05cb72f014c tempest-VolumesActionsTest-1533429368 None] Lock "cinder-quobyte-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6" acquired by "delete_volume" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:55 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[43af430f-2a23-4071-bd95-9b9c7caa5d75]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0104e491-fe79-4956-bafa-c05cb72f014c tempest-VolumesActionsTest-1533429368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f34355d6-2b44-494e-bb17-7a6fa9cddbf3 tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "cinder-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:56 devstack sudo[96132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6
Nov 05 15:10:56 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f34355d6-2b44-494e-bb17-7a6fa9cddbf3 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f34355d6-2b44-494e-bb17-7a6fa9cddbf3 tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "cinder-quobyte-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:10:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f34355d6-2b44-494e-bb17-7a6fa9cddbf3 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-quobyte-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0" acquired by "delete_volume" :: waited 0.033s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:10:56 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.500s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:56 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:10:56 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Deleted volume successfully.
Nov 05 15:10:56 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2019c4-41c6-4065-b1ed-a8a7bcc97058]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:10:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f34355d6-2b44-494e-bb17-7a6fa9cddbf3 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e433d807-596f-477a-b9b8-bb1c89719469 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-86faf752-7a51-4d10-9467-7a64177dcdad-delete_volume" released by "delete_volume" :: held 4.932s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:56 devstack sudo[96135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0
Nov 05 15:10:56 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:56 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0104e491-fe79-4956-bafa-c05cb72f014c tempest-VolumesActionsTest-1533429368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6" returned: 0 in 0.547s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0104e491-fe79-4956-bafa-c05cb72f014c tempest-VolumesActionsTest-1533429368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:56 devstack sudo[96140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6
Nov 05 15:10:56 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:56 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0104e491-fe79-4956-bafa-c05cb72f014c tempest-VolumesActionsTest-1533429368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6" returned: 0 in 0.333s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:56 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f34355d6-2b44-494e-bb17-7a6fa9cddbf3 tempest-VolumesDeleteCascade-2046481341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0" returned: 0 in 0.514s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f34355d6-2b44-494e-bb17-7a6fa9cddbf3 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0104e491-fe79-4956-bafa-c05cb72f014c tempest-VolumesActionsTest-1533429368 None] Lock "cinder-quobyte-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6" released by "delete_volume" :: held 0.970s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:56 devstack sudo[96146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0
Nov 05 15:10:56 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:56 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-0104e491-fe79-4956-bafa-c05cb72f014c tempest-VolumesActionsTest-1533429368 None] Created reservations ['c4cf4f43-c42f-446c-abd6-a23066289793', '414ef2be-3fc5-4def-9406-a0c74ef87e37', '0b05e259-3ce1-412a-aba5-d1dca75190ee', '9b1d779c-0732-4859-90c5-ae692578647b'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:10:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0104e491-fe79-4956-bafa-c05cb72f014c tempest-VolumesActionsTest-1533429368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:10:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0104e491-fe79-4956-bafa-c05cb72f014c tempest-VolumesActionsTest-1533429368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:10:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0104e491-fe79-4956-bafa-c05cb72f014c tempest-VolumesActionsTest-1533429368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:10:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0104e491-fe79-4956-bafa-c05cb72f014c tempest-VolumesActionsTest-1533429368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:10:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0104e491-fe79-4956-bafa-c05cb72f014c tempest-VolumesActionsTest-1533429368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0104e491-fe79-4956-bafa-c05cb72f014c tempest-VolumesActionsTest-1533429368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:57 devstack sudo[96148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:10:57 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:57 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f34355d6-2b44-494e-bb17-7a6fa9cddbf3 tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0" returned: 0 in 0.323s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f34355d6-2b44-494e-bb17-7a6fa9cddbf3 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-quobyte-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0" released by "delete_volume" :: held 0.937s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:57 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-f34355d6-2b44-494e-bb17-7a6fa9cddbf3 tempest-VolumesDeleteCascade-2046481341 None] Created reservations ['8eeed77b-b79a-47f5-ac12-a761703c89aa', '3a404452-4664-4240-a70d-62e32d0c4afc', 'c9f8f574-1f1e-4217-aafc-b284450db295', '70e0c275-cac4-46ad-a5f8-af1e2a6ce0eb'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:10:57 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0104e491-fe79-4956-bafa-c05cb72f014c tempest-VolumesActionsTest-1533429368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.354s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:57 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-0104e491-fe79-4956-bafa-c05cb72f014c tempest-VolumesActionsTest-1533429368 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:10:57 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0104e491-fe79-4956-bafa-c05cb72f014c tempest-VolumesActionsTest-1533429368 None] Deleted volume successfully.
Nov 05 15:10:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f34355d6-2b44-494e-bb17-7a6fa9cddbf3 tempest-VolumesDeleteCascade-2046481341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:10:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f34355d6-2b44-494e-bb17-7a6fa9cddbf3 tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:10:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f34355d6-2b44-494e-bb17-7a6fa9cddbf3 tempest-VolumesDeleteCascade-2046481341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:10:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f34355d6-2b44-494e-bb17-7a6fa9cddbf3 tempest-VolumesDeleteCascade-2046481341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:10:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f34355d6-2b44-494e-bb17-7a6fa9cddbf3 tempest-VolumesDeleteCascade-2046481341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:10:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f34355d6-2b44-494e-bb17-7a6fa9cddbf3 tempest-VolumesDeleteCascade-2046481341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:10:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0104e491-fe79-4956-bafa-c05cb72f014c tempest-VolumesActionsTest-1533429368 None] Lock "cinder-ccc69ca8-c2c6-4242-bd14-d0c39ed68cd6-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:10:57 devstack sudo[96152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:10:57 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:10:57 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root
Nov 05 15:10:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f34355d6-2b44-494e-bb17-7a6fa9cddbf3 tempest-VolumesDeleteCascade-2046481341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.275s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:10:57 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-f34355d6-2b44-494e-bb17-7a6fa9cddbf3 tempest-VolumesDeleteCascade-2046481341 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:10:57 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f34355d6-2b44-494e-bb17-7a6fa9cddbf3 tempest-VolumesDeleteCascade-2046481341 None] Deleted volume successfully.
Nov 05 15:10:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f34355d6-2b44-494e-bb17-7a6fa9cddbf3 tempest-VolumesDeleteCascade-2046481341 None] Lock "cinder-6af16f5a-f180-4ede-9e84-89a3bcf7b4a0-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:11:07 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:INSERT=16,cinder:UPDATE=58,cinder:SELECT=36,cinder:DELETE=4 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:11:07 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=62,cinder:INSERT=14,cinder:DELETE=5,cinder:SELECT=49 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:11:07 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:11:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Flow 'volume_create_manager' (1419d505-ec3c-4093-adf5-b96e6912ca1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:11:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da190ab-97c8-4dbc-80cd-54b799f32f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da190ab-97c8-4dbc-80cd-54b799f32f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-608689114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e44413-73c0-4a54-bee7-977cfbe443d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4148da727d46b0b38bbe7e12700ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:08Z,use_quota=True,user_id='850eca358ca4492ab97a3790837e0e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a5dfb7-15e7-43a7-a4e4-c7c165dd26fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a5dfb7-15e7-43a7-a4e4-c7c165dd26fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d0444de-451b-4c90-a9b4-68d076b9d6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d0444de-451b-4c90-a9b4-68d076b9d6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3e44413-73c0-4a54-bee7-977cfbe443d5', 'volume_name': 'volume-e3e44413-73c0-4a54-bee7-977cfbe443d5', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ec0760-e990-4bc5-99f2-2e497ead8bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ec0760-e990-4bc5-99f2-2e497ead8bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (515e8c2e-30cc-4a85-9065-83b5e30061bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:08 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Volume e3e44413-73c0-4a54-bee7-977cfbe443d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3e44413-73c0-4a54-bee7-977cfbe443d5', 'volume_size': 1}
Nov 05 15:11:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-608689114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e44413-73c0-4a54-bee7-977cfbe443d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4148da727d46b0b38bbe7e12700ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:08Z,use_quota=True,user_id='850eca358ca4492ab97a3790837e0e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:11:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Creating volume e3e44413-73c0-4a54-bee7-977cfbe443d5 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:11:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:11:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:11:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:11:08 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:11:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e3e44413-73c0-4a54-bee7-977cfbe443d5 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:08 devstack sudo[96181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e3e44413-73c0-4a54-bee7-977cfbe443d5 1073741824
Nov 05 15:11:08 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:08 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e3e44413-73c0-4a54-bee7-977cfbe443d5 1073741824" returned: 0 in 0.625s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e3e44413-73c0-4a54-bee7-977cfbe443d5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:08 devstack sudo[96189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e3e44413-73c0-4a54-bee7-977cfbe443d5
Nov 05 15:11:08 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:09 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e3e44413-73c0-4a54-bee7-977cfbe443d5" returned: 0 in 0.335s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (515e8c2e-30cc-4a85-9065-83b5e30061bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3e44413-73c0-4a54-bee7-977cfbe443d5', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e6d580-3daa-4584-9262-0ae137746090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:09 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Volume volume-e3e44413-73c0-4a54-bee7-977cfbe443d5 (e3e44413-73c0-4a54-bee7-977cfbe443d5): created successfully
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e6d580-3daa-4584-9262-0ae137746090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Flow 'volume_create_manager' (1419d505-ec3c-4093-adf5-b96e6912ca1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:11:09 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-74660065-7945-4bc5-9d56-5fec316ccd7e tempest-VolumesActionsTest-1533429368 None] Created volume successfully.
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Flow 'volume_create_manager' (b86631c4-aece-4bf6-b522-ebad407a03f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7c7d2fb-cd78-4bc5-9f3e-cb0ce178c585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7c7d2fb-cd78-4bc5-9f3e-cb0ce178c585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-208352641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a2a6f7-65cb-4501-a2a0-ca32502c8086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5db5a227c03e461c88e81f3343861b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:10Z,use_quota=True,user_id='1217191a296f458889fdc8b466e84d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c503d974-a428-4767-acd8-67ba208d0170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c503d974-a428-4767-acd8-67ba208d0170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10bdfc15-4407-4618-a94d-107a4e5b1c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10bdfc15-4407-4618-a94d-107a4e5b1c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42a2a6f7-65cb-4501-a2a0-ca32502c8086', 'volume_name': 'volume-42a2a6f7-65cb-4501-a2a0-ca32502c8086', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f73e47b8-8273-47fd-9a38-ef37cb851d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f73e47b8-8273-47fd-9a38-ef37cb851d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3e6486-8f58-4744-b2a3-e5c2ad680601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:09 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Volume 42a2a6f7-65cb-4501-a2a0-ca32502c8086: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42a2a6f7-65cb-4501-a2a0-ca32502c8086', 'volume_size': 1}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-208352641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a2a6f7-65cb-4501-a2a0-ca32502c8086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5db5a227c03e461c88e81f3343861b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:10Z,use_quota=True,user_id='1217191a296f458889fdc8b466e84d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Creating volume 42a2a6f7-65cb-4501-a2a0-ca32502c8086 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:11:09 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:11:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-42a2a6f7-65cb-4501-a2a0-ca32502c8086 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:09 devstack sudo[96192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-42a2a6f7-65cb-4501-a2a0-ca32502c8086 1073741824
Nov 05 15:11:09 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-755c1f84-1138-4724-a50c-e7acd7ed82f2 tempest-VolumesActionsTest-2062653536 None] Acquiring lock "cinder-e3e44413-73c0-4a54-bee7-977cfbe443d5-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:11:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-755c1f84-1138-4724-a50c-e7acd7ed82f2 tempest-VolumesActionsTest-2062653536 None] Lock "cinder-e3e44413-73c0-4a54-bee7-977cfbe443d5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:11:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-755c1f84-1138-4724-a50c-e7acd7ed82f2 tempest-VolumesActionsTest-2062653536 None] Acquiring lock "cinder-quobyte-e3e44413-73c0-4a54-bee7-977cfbe443d5" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:11:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-755c1f84-1138-4724-a50c-e7acd7ed82f2 tempest-VolumesActionsTest-2062653536 None] Lock "cinder-quobyte-e3e44413-73c0-4a54-bee7-977cfbe443d5" acquired by "delete_volume" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:11:10 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[607a6ddd-0c83-4ff8-a112-68271473136c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:11:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-755c1f84-1138-4724-a50c-e7acd7ed82f2 tempest-VolumesActionsTest-2062653536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e3e44413-73c0-4a54-bee7-977cfbe443d5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:10 devstack sudo[96197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e3e44413-73c0-4a54-bee7-977cfbe443d5
Nov 05 15:11:10 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:10 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-42a2a6f7-65cb-4501-a2a0-ca32502c8086 1073741824" returned: 0 in 0.598s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-42a2a6f7-65cb-4501-a2a0-ca32502c8086 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:10 devstack sudo[96200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-42a2a6f7-65cb-4501-a2a0-ca32502c8086
Nov 05 15:11:10 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:10 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-755c1f84-1138-4724-a50c-e7acd7ed82f2 tempest-VolumesActionsTest-2062653536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e3e44413-73c0-4a54-bee7-977cfbe443d5" returned: 0 in 0.481s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-755c1f84-1138-4724-a50c-e7acd7ed82f2 tempest-VolumesActionsTest-2062653536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e3e44413-73c0-4a54-bee7-977cfbe443d5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:10 devstack sudo[96205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e3e44413-73c0-4a54-bee7-977cfbe443d5
Nov 05 15:11:10 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:10 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-42a2a6f7-65cb-4501-a2a0-ca32502c8086" returned: 0 in 0.367s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:11:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3e6486-8f58-4744-b2a3-e5c2ad680601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42a2a6f7-65cb-4501-a2a0-ca32502c8086', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b897e4a7-394b-41fe-bbad-106b0572991f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:10 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Volume volume-42a2a6f7-65cb-4501-a2a0-ca32502c8086 (42a2a6f7-65cb-4501-a2a0-ca32502c8086): created successfully
Nov 05 15:11:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b897e4a7-394b-41fe-bbad-106b0572991f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Flow 'volume_create_manager' (b86631c4-aece-4bf6-b522-ebad407a03f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:11:11 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-05ee17c7-1fe0-44e8-8522-f854d13ae9ad tempest-VolumesMetadataTest-1413600793 None] Created volume successfully.
Nov 05 15:11:11 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-755c1f84-1138-4724-a50c-e7acd7ed82f2 tempest-VolumesActionsTest-2062653536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e3e44413-73c0-4a54-bee7-977cfbe443d5" returned: 0 in 0.325s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-755c1f84-1138-4724-a50c-e7acd7ed82f2 tempest-VolumesActionsTest-2062653536 None] Lock "cinder-quobyte-e3e44413-73c0-4a54-bee7-977cfbe443d5" released by "delete_volume" :: held 0.856s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:11:11 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-755c1f84-1138-4724-a50c-e7acd7ed82f2 tempest-VolumesActionsTest-2062653536 None] Created reservations ['3ae37809-fc96-40cb-95c6-ee278de743f8', 'a4e96c0d-c254-4a09-9a4c-429e74320f6e', 'c50cdab4-472d-4810-9b7d-936a358502bb', 'bec171d5-1655-4330-97d2-1a091c9cfbe7'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:11:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-755c1f84-1138-4724-a50c-e7acd7ed82f2 tempest-VolumesActionsTest-2062653536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-755c1f84-1138-4724-a50c-e7acd7ed82f2 tempest-VolumesActionsTest-2062653536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-755c1f84-1138-4724-a50c-e7acd7ed82f2 tempest-VolumesActionsTest-2062653536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:11:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-755c1f84-1138-4724-a50c-e7acd7ed82f2 tempest-VolumesActionsTest-2062653536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:11:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-755c1f84-1138-4724-a50c-e7acd7ed82f2 tempest-VolumesActionsTest-2062653536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-755c1f84-1138-4724-a50c-e7acd7ed82f2 tempest-VolumesActionsTest-2062653536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:11 devstack sudo[96209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:11:11 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:11 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-755c1f84-1138-4724-a50c-e7acd7ed82f2 tempest-VolumesActionsTest-2062653536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.446s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:11 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-755c1f84-1138-4724-a50c-e7acd7ed82f2 tempest-VolumesActionsTest-2062653536 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:11:11 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-755c1f84-1138-4724-a50c-e7acd7ed82f2 tempest-VolumesActionsTest-2062653536 None] Deleted volume successfully.
Nov 05 15:11:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-755c1f84-1138-4724-a50c-e7acd7ed82f2 tempest-VolumesActionsTest-2062653536 None] Lock "cinder-e3e44413-73c0-4a54-bee7-977cfbe443d5-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:11:12 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:11:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Flow 'volume_create_manager' (0a8aaecf-69d9-4580-a662-15215cb5ae0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:11:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b067dc9-d2a8-4577-8994-3694a6e8e85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b067dc9-d2a8-4577-8994-3694a6e8e85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-812316051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b39fb2c-5102-4886-a504-752598f72e1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4148da727d46b0b38bbe7e12700ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:12Z,use_quota=True,user_id='850eca358ca4492ab97a3790837e0e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7adcffd-abb5-4f0f-8ec3-c7eada516680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7adcffd-abb5-4f0f-8ec3-c7eada516680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08fb52d-9e6b-44eb-904b-cc10be78f290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08fb52d-9e6b-44eb-904b-cc10be78f290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b39fb2c-5102-4886-a504-752598f72e1b', 'volume_name': 'volume-2b39fb2c-5102-4886-a504-752598f72e1b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb6ee87-b5c5-4869-b8c5-735a352082b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb6ee87-b5c5-4869-b8c5-735a352082b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7feba32-a368-445f-9b25-2e2fbf27c430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:12 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Volume 2b39fb2c-5102-4886-a504-752598f72e1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b39fb2c-5102-4886-a504-752598f72e1b', 'volume_size': 1}
Nov 05 15:11:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-812316051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b39fb2c-5102-4886-a504-752598f72e1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4148da727d46b0b38bbe7e12700ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:12Z,use_quota=True,user_id='850eca358ca4492ab97a3790837e0e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:11:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Creating volume 2b39fb2c-5102-4886-a504-752598f72e1b {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:11:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:11:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:11:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:11:12 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:11:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2b39fb2c-5102-4886-a504-752598f72e1b 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:12 devstack sudo[96212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2b39fb2c-5102-4886-a504-752598f72e1b 1073741824
Nov 05 15:11:12 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:13 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2b39fb2c-5102-4886-a504-752598f72e1b 1073741824" returned: 0 in 0.840s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-998faab0-30e9-4baa-b40a-59707945a102 tempest-VolumesMetadataTest-1413600793 None] Acquiring lock "cinder-42a2a6f7-65cb-4501-a2a0-ca32502c8086-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:11:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-998faab0-30e9-4baa-b40a-59707945a102 tempest-VolumesMetadataTest-1413600793 None] Lock "cinder-42a2a6f7-65cb-4501-a2a0-ca32502c8086-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:11:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2b39fb2c-5102-4886-a504-752598f72e1b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:13 devstack sudo[96218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2b39fb2c-5102-4886-a504-752598f72e1b
Nov 05 15:11:13 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-998faab0-30e9-4baa-b40a-59707945a102 tempest-VolumesMetadataTest-1413600793 None] Acquiring lock "cinder-quobyte-42a2a6f7-65cb-4501-a2a0-ca32502c8086" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:11:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-998faab0-30e9-4baa-b40a-59707945a102 tempest-VolumesMetadataTest-1413600793 None] Lock "cinder-quobyte-42a2a6f7-65cb-4501-a2a0-ca32502c8086" acquired by "delete_volume" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:11:13 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed6b257-24e7-4df3-8096-173b24e690d4]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:11:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-998faab0-30e9-4baa-b40a-59707945a102 tempest-VolumesMetadataTest-1413600793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-42a2a6f7-65cb-4501-a2a0-ca32502c8086 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:13 devstack sudo[96220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-42a2a6f7-65cb-4501-a2a0-ca32502c8086
Nov 05 15:11:13 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:13 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2b39fb2c-5102-4886-a504-752598f72e1b" returned: 0 in 0.512s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:11:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7feba32-a368-445f-9b25-2e2fbf27c430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b39fb2c-5102-4886-a504-752598f72e1b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d2d835-1499-4103-9625-b07006873475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:13 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Volume volume-2b39fb2c-5102-4886-a504-752598f72e1b (2b39fb2c-5102-4886-a504-752598f72e1b): created successfully
Nov 05 15:11:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d2d835-1499-4103-9625-b07006873475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Flow 'volume_create_manager' (0a8aaecf-69d9-4580-a662-15215cb5ae0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:11:13 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c287543a-3777-496c-9262-4365392bca63 tempest-VolumesActionsTest-1533429368 None] Created volume successfully.
Nov 05 15:11:13 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-998faab0-30e9-4baa-b40a-59707945a102 tempest-VolumesMetadataTest-1413600793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-42a2a6f7-65cb-4501-a2a0-ca32502c8086" returned: 0 in 0.512s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-998faab0-30e9-4baa-b40a-59707945a102 tempest-VolumesMetadataTest-1413600793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-42a2a6f7-65cb-4501-a2a0-ca32502c8086 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:13 devstack sudo[96226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-42a2a6f7-65cb-4501-a2a0-ca32502c8086
Nov 05 15:11:13 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:14 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-998faab0-30e9-4baa-b40a-59707945a102 tempest-VolumesMetadataTest-1413600793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-42a2a6f7-65cb-4501-a2a0-ca32502c8086" returned: 0 in 0.333s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-998faab0-30e9-4baa-b40a-59707945a102 tempest-VolumesMetadataTest-1413600793 None] Lock "cinder-quobyte-42a2a6f7-65cb-4501-a2a0-ca32502c8086" released by "delete_volume" :: held 0.933s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:11:14 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-998faab0-30e9-4baa-b40a-59707945a102 tempest-VolumesMetadataTest-1413600793 None] Created reservations ['e2e53973-5b1f-40b6-89aa-d7e19a46125f', 'f64facac-8f11-40c7-b8f1-6eebe49ebaab', 'bbc7cfe0-ac89-4d77-98b5-85745dd83fa1', 'd7551187-402f-4c15-9033-6c2a99cbe438'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:11:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-998faab0-30e9-4baa-b40a-59707945a102 tempest-VolumesMetadataTest-1413600793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-998faab0-30e9-4baa-b40a-59707945a102 tempest-VolumesMetadataTest-1413600793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-998faab0-30e9-4baa-b40a-59707945a102 tempest-VolumesMetadataTest-1413600793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:11:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-998faab0-30e9-4baa-b40a-59707945a102 tempest-VolumesMetadataTest-1413600793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:11:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-998faab0-30e9-4baa-b40a-59707945a102 tempest-VolumesMetadataTest-1413600793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-998faab0-30e9-4baa-b40a-59707945a102 tempest-VolumesMetadataTest-1413600793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ed724d0c-42d9-4625-a396-9e49ba3f650b tempest-VolumesActionsTest-2062653536 None] Acquiring lock "cinder-2b39fb2c-5102-4886-a504-752598f72e1b-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:11:14 devstack sudo[96229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:11:14 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ed724d0c-42d9-4625-a396-9e49ba3f650b tempest-VolumesActionsTest-2062653536 None] Lock "cinder-2b39fb2c-5102-4886-a504-752598f72e1b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:11:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ed724d0c-42d9-4625-a396-9e49ba3f650b tempest-VolumesActionsTest-2062653536 None] Acquiring lock "cinder-quobyte-2b39fb2c-5102-4886-a504-752598f72e1b" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:11:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ed724d0c-42d9-4625-a396-9e49ba3f650b tempest-VolumesActionsTest-2062653536 None] Lock "cinder-quobyte-2b39fb2c-5102-4886-a504-752598f72e1b" acquired by "delete_volume" :: waited 0.024s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:11:14 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[00134a61-3e4d-4808-af90-d1bd97f6c86f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:11:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ed724d0c-42d9-4625-a396-9e49ba3f650b tempest-VolumesActionsTest-2062653536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2b39fb2c-5102-4886-a504-752598f72e1b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:14 devstack sudo[96231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2b39fb2c-5102-4886-a504-752598f72e1b
Nov 05 15:11:14 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:14 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-998faab0-30e9-4baa-b40a-59707945a102 tempest-VolumesMetadataTest-1413600793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.387s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:14 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-998faab0-30e9-4baa-b40a-59707945a102 tempest-VolumesMetadataTest-1413600793 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:11:14 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-998faab0-30e9-4baa-b40a-59707945a102 tempest-VolumesMetadataTest-1413600793 None] Deleted volume successfully.
Nov 05 15:11:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-998faab0-30e9-4baa-b40a-59707945a102 tempest-VolumesMetadataTest-1413600793 None] Lock "cinder-42a2a6f7-65cb-4501-a2a0-ca32502c8086-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:11:15 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ed724d0c-42d9-4625-a396-9e49ba3f650b tempest-VolumesActionsTest-2062653536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2b39fb2c-5102-4886-a504-752598f72e1b" returned: 0 in 0.479s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ed724d0c-42d9-4625-a396-9e49ba3f650b tempest-VolumesActionsTest-2062653536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2b39fb2c-5102-4886-a504-752598f72e1b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:15 devstack sudo[96238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2b39fb2c-5102-4886-a504-752598f72e1b
Nov 05 15:11:15 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:15 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ed724d0c-42d9-4625-a396-9e49ba3f650b tempest-VolumesActionsTest-2062653536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2b39fb2c-5102-4886-a504-752598f72e1b" returned: 0 in 0.321s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ed724d0c-42d9-4625-a396-9e49ba3f650b tempest-VolumesActionsTest-2062653536 None] Lock "cinder-quobyte-2b39fb2c-5102-4886-a504-752598f72e1b" released by "delete_volume" :: held 0.867s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:11:15 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-ed724d0c-42d9-4625-a396-9e49ba3f650b tempest-VolumesActionsTest-2062653536 None] Created reservations ['81766079-aa00-4a2c-9c4f-52e90bff78e2', '8449e508-9eb3-451a-ae5e-c2a19250b03d', 'e72a2123-a7bc-4d92-8cb2-2558dde7c44a', '0c4f8405-cbf9-4a1a-b9e4-06c6edd9f4d6'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:11:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ed724d0c-42d9-4625-a396-9e49ba3f650b tempest-VolumesActionsTest-2062653536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ed724d0c-42d9-4625-a396-9e49ba3f650b tempest-VolumesActionsTest-2062653536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ed724d0c-42d9-4625-a396-9e49ba3f650b tempest-VolumesActionsTest-2062653536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:11:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ed724d0c-42d9-4625-a396-9e49ba3f650b tempest-VolumesActionsTest-2062653536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:11:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ed724d0c-42d9-4625-a396-9e49ba3f650b tempest-VolumesActionsTest-2062653536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ed724d0c-42d9-4625-a396-9e49ba3f650b tempest-VolumesActionsTest-2062653536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:15 devstack sudo[96241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:11:15 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:16 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ed724d0c-42d9-4625-a396-9e49ba3f650b tempest-VolumesActionsTest-2062653536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.292s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:16 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-ed724d0c-42d9-4625-a396-9e49ba3f650b tempest-VolumesActionsTest-2062653536 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:11:16 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ed724d0c-42d9-4625-a396-9e49ba3f650b tempest-VolumesActionsTest-2062653536 None] Deleted volume successfully.
Nov 05 15:11:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ed724d0c-42d9-4625-a396-9e49ba3f650b tempest-VolumesActionsTest-2062653536 None] Lock "cinder-2b39fb2c-5102-4886-a504-752598f72e1b-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:11:17 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:11:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Flow 'volume_create_manager' (56142bda-acf6-488d-be10-3b4354939b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:11:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f7d4e5-f874-494b-b14e-c16f621fb101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f7d4e5-f874-494b-b14e-c16f621fb101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-478598719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99fd431a-bfa9-4e58-9d51-348306419cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4148da727d46b0b38bbe7e12700ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:17Z,use_quota=True,user_id='850eca358ca4492ab97a3790837e0e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44af464f-c5ed-4406-8614-d7dcc04f26d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44af464f-c5ed-4406-8614-d7dcc04f26d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbbcbcd7-4e2a-4672-b278-f669cd6b5b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbbcbcd7-4e2a-4672-b278-f669cd6b5b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99fd431a-bfa9-4e58-9d51-348306419cc4', 'volume_name': 'volume-99fd431a-bfa9-4e58-9d51-348306419cc4', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2679e07a-cd8d-48b7-bcb7-b782852daf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2679e07a-cd8d-48b7-bcb7-b782852daf60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d713557d-7170-40e6-8da4-290585932cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:17 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Volume 99fd431a-bfa9-4e58-9d51-348306419cc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99fd431a-bfa9-4e58-9d51-348306419cc4', 'volume_size': 1}
Nov 05 15:11:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-478598719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99fd431a-bfa9-4e58-9d51-348306419cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4148da727d46b0b38bbe7e12700ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:17Z,use_quota=True,user_id='850eca358ca4492ab97a3790837e0e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:11:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Creating volume 99fd431a-bfa9-4e58-9d51-348306419cc4 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:11:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:11:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:11:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:11:17 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:11:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-99fd431a-bfa9-4e58-9d51-348306419cc4 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:17 devstack sudo[96280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-99fd431a-bfa9-4e58-9d51-348306419cc4 1073741824
Nov 05 15:11:17 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:18 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-99fd431a-bfa9-4e58-9d51-348306419cc4 1073741824" returned: 0 in 0.607s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-99fd431a-bfa9-4e58-9d51-348306419cc4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:18 devstack sudo[96287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-99fd431a-bfa9-4e58-9d51-348306419cc4
Nov 05 15:11:18 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:18 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-99fd431a-bfa9-4e58-9d51-348306419cc4" returned: 0 in 0.308s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:11:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d713557d-7170-40e6-8da4-290585932cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99fd431a-bfa9-4e58-9d51-348306419cc4', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4e5b06-2a1b-403b-9d9f-674b37bb08df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:18 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Volume volume-99fd431a-bfa9-4e58-9d51-348306419cc4 (99fd431a-bfa9-4e58-9d51-348306419cc4): created successfully
Nov 05 15:11:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4e5b06-2a1b-403b-9d9f-674b37bb08df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Flow 'volume_create_manager' (56142bda-acf6-488d-be10-3b4354939b84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:11:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-18ebb3b3-c17a-469c-a7ce-7d4278700f50 tempest-VolumesActionsTest-1533429368 None] Created volume successfully.
Nov 05 15:11:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e8c10805-b937-4c30-9852-592f3bcfe067 tempest-VolumesActionsTest-2062653536 None] Acquiring lock "cinder-99fd431a-bfa9-4e58-9d51-348306419cc4-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:11:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e8c10805-b937-4c30-9852-592f3bcfe067 tempest-VolumesActionsTest-2062653536 None] Lock "cinder-99fd431a-bfa9-4e58-9d51-348306419cc4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:11:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e8c10805-b937-4c30-9852-592f3bcfe067 tempest-VolumesActionsTest-2062653536 None] Acquiring lock "cinder-quobyte-99fd431a-bfa9-4e58-9d51-348306419cc4" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:11:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e8c10805-b937-4c30-9852-592f3bcfe067 tempest-VolumesActionsTest-2062653536 None] Lock "cinder-quobyte-99fd431a-bfa9-4e58-9d51-348306419cc4" acquired by "delete_volume" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:11:19 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eabd1e0-f188-4053-86c4-0de9dd06f081]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:11:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e8c10805-b937-4c30-9852-592f3bcfe067 tempest-VolumesActionsTest-2062653536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-99fd431a-bfa9-4e58-9d51-348306419cc4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:20 devstack sudo[96291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-99fd431a-bfa9-4e58-9d51-348306419cc4
Nov 05 15:11:20 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:20 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e8c10805-b937-4c30-9852-592f3bcfe067 tempest-VolumesActionsTest-2062653536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-99fd431a-bfa9-4e58-9d51-348306419cc4" returned: 0 in 0.542s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e8c10805-b937-4c30-9852-592f3bcfe067 tempest-VolumesActionsTest-2062653536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-99fd431a-bfa9-4e58-9d51-348306419cc4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:20 devstack sudo[96302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-99fd431a-bfa9-4e58-9d51-348306419cc4
Nov 05 15:11:20 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:20 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e8c10805-b937-4c30-9852-592f3bcfe067 tempest-VolumesActionsTest-2062653536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-99fd431a-bfa9-4e58-9d51-348306419cc4" returned: 0 in 0.343s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e8c10805-b937-4c30-9852-592f3bcfe067 tempest-VolumesActionsTest-2062653536 None] Lock "cinder-quobyte-99fd431a-bfa9-4e58-9d51-348306419cc4" released by "delete_volume" :: held 0.966s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:11:20 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-e8c10805-b937-4c30-9852-592f3bcfe067 tempest-VolumesActionsTest-2062653536 None] Created reservations ['efb16212-4b10-45fd-be13-6ba0f33c20a8', 'c7e6b342-175a-4925-8e15-95a94c3d205f', '217c2367-2d94-47f9-a9eb-9d6d8f02525e', '404997b5-dbe4-45e6-9ac5-ac4a327ab3f9'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:11:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e8c10805-b937-4c30-9852-592f3bcfe067 tempest-VolumesActionsTest-2062653536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e8c10805-b937-4c30-9852-592f3bcfe067 tempest-VolumesActionsTest-2062653536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e8c10805-b937-4c30-9852-592f3bcfe067 tempest-VolumesActionsTest-2062653536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:11:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e8c10805-b937-4c30-9852-592f3bcfe067 tempest-VolumesActionsTest-2062653536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:11:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e8c10805-b937-4c30-9852-592f3bcfe067 tempest-VolumesActionsTest-2062653536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e8c10805-b937-4c30-9852-592f3bcfe067 tempest-VolumesActionsTest-2062653536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:21 devstack sudo[96308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:11:21 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:21 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e8c10805-b937-4c30-9852-592f3bcfe067 tempest-VolumesActionsTest-2062653536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.429s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:21 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-e8c10805-b937-4c30-9852-592f3bcfe067 tempest-VolumesActionsTest-2062653536 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:11:21 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e8c10805-b937-4c30-9852-592f3bcfe067 tempest-VolumesActionsTest-2062653536 None] Deleted volume successfully.
Nov 05 15:11:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e8c10805-b937-4c30-9852-592f3bcfe067 tempest-VolumesActionsTest-2062653536 None] Lock "cinder-99fd431a-bfa9-4e58-9d51-348306419cc4-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Flow 'volume_create_manager' (667ef2f1-d801-419e-aea8-0fe13a9dbae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b2eb17-723a-4178-a3b2-ca6634666535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b2eb17-723a-4178-a3b2-ca6634666535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1104570878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0fb7ba-f48e-47ed-80db-6b45f74acc2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4148da727d46b0b38bbe7e12700ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:23Z,use_quota=True,user_id='850eca358ca4492ab97a3790837e0e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d543e2d-7b0b-4f1e-8bab-5c6f95d742a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d543e2d-7b0b-4f1e-8bab-5c6f95d742a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ed87f6-713d-40e8-a06b-ad6800819a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ed87f6-713d-40e8-a06b-ad6800819a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af0fb7ba-f48e-47ed-80db-6b45f74acc2b', 'volume_name': 'volume-af0fb7ba-f48e-47ed-80db-6b45f74acc2b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90eb9180-f632-464c-a5a4-c372dfc49d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90eb9180-f632-464c-a5a4-c372dfc49d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56535718-b0af-44d5-8d4e-43d63e3279a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:23 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Volume af0fb7ba-f48e-47ed-80db-6b45f74acc2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af0fb7ba-f48e-47ed-80db-6b45f74acc2b', 'volume_size': 1}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1104570878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0fb7ba-f48e-47ed-80db-6b45f74acc2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4148da727d46b0b38bbe7e12700ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:23Z,use_quota=True,user_id='850eca358ca4492ab97a3790837e0e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Creating volume af0fb7ba-f48e-47ed-80db-6b45f74acc2b {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:11:23 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af0fb7ba-f48e-47ed-80db-6b45f74acc2b 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:11:23 devstack sudo[96328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af0fb7ba-f48e-47ed-80db-6b45f74acc2b 1073741824
Nov 05 15:11:23 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Flow 'volume_create_manager' (0d944829-3866-4020-be3d-160dc0136992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f088d7c9-6ac4-4305-989e-52a9a2069bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f088d7c9-6ac4-4305-989e-52a9a2069bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1716690012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da3fe57-b120-4252-883a-28768df19888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0a9f56a9094642b598d695fa3cb390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:23Z,use_quota=True,user_id='3977e1c856504983ac1ae4627ebdce44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dbda396-10d0-4aa4-8d8c-2ed0b969ef7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dbda396-10d0-4aa4-8d8c-2ed0b969ef7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f157b24-3077-498a-83ba-42585a0df5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f157b24-3077-498a-83ba-42585a0df5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5da3fe57-b120-4252-883a-28768df19888', 'volume_name': 'volume-5da3fe57-b120-4252-883a-28768df19888', 'volume_size': 2}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b2e50d-57d3-49a4-82f5-3ac6b8c1ac31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b2e50d-57d3-49a4-82f5-3ac6b8c1ac31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b48d40-0ba3-4955-9962-628909eef07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:23 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Volume 5da3fe57-b120-4252-883a-28768df19888: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5da3fe57-b120-4252-883a-28768df19888', 'volume_size': 2}
Nov 05 15:11:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Flow 'volume_create_manager' (6e612617-978b-4ea4-b18b-fad81f66746f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fcdfd48-a6d3-4f7a-9091-8d76e7ede6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fcdfd48-a6d3-4f7a-9091-8d76e7ede6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2085896433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c477a72e-838b-4440-b234-e27ce72c9768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fde7ba0bd2f4e7bab8ba379d6c352a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:24Z,use_quota=True,user_id='9d139cb520204951934ac5148895b694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f8e9ed-e9f1-48b1-895e-47a13c54e5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f8e9ed-e9f1-48b1-895e-47a13c54e5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5063843a-6d60-4108-9a10-53690af30b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5063843a-6d60-4108-9a10-53690af30b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c477a72e-838b-4440-b234-e27ce72c9768', 'volume_name': 'volume-c477a72e-838b-4440-b234-e27ce72c9768', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f6a9b7d-77b9-40be-b8eb-7ce23492b2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f6a9b7d-77b9-40be-b8eb-7ce23492b2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:24 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (494bd3c7-3a48-4db1-999a-b4547015fa73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:24 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Volume c477a72e-838b-4440-b234-e27ce72c9768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c477a72e-838b-4440-b234-e27ce72c9768', 'volume_size': 1}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af0fb7ba-f48e-47ed-80db-6b45f74acc2b 1073741824" returned: 0 in 0.627s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af0fb7ba-f48e-47ed-80db-6b45f74acc2b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:24 devstack sudo[96337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af0fb7ba-f48e-47ed-80db-6b45f74acc2b
Nov 05 15:11:24 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:24 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af0fb7ba-f48e-47ed-80db-6b45f74acc2b" returned: 0 in 0.275s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.788s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1716690012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da3fe57-b120-4252-883a-28768df19888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0a9f56a9094642b598d695fa3cb390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:23Z,use_quota=True,user_id='3977e1c856504983ac1ae4627ebdce44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Creating volume 5da3fe57-b120-4252-883a-28768df19888 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:11:24 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5da3fe57-b120-4252-883a-28768df19888 2147483648 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:24 devstack sudo[96340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5da3fe57-b120-4252-883a-28768df19888 2147483648
Nov 05 15:11:24 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56535718-b0af-44d5-8d4e-43d63e3279a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af0fb7ba-f48e-47ed-80db-6b45f74acc2b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3234c0fe-beb6-40ed-bfea-b393c507a34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:24 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Volume volume-af0fb7ba-f48e-47ed-80db-6b45f74acc2b (af0fb7ba-f48e-47ed-80db-6b45f74acc2b): created successfully
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3234c0fe-beb6-40ed-bfea-b393c507a34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Flow 'volume_create_manager' (667ef2f1-d801-419e-aea8-0fe13a9dbae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:11:24 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4bcd3b8b-f053-48ed-b6ed-91d0623bfa1d tempest-VolumesActionsTest-1533429368 None] Created volume successfully.
Nov 05 15:11:25 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5da3fe57-b120-4252-883a-28768df19888 2147483648" returned: 0 in 0.694s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5da3fe57-b120-4252-883a-28768df19888 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:25 devstack sudo[96350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5da3fe57-b120-4252-883a-28768df19888
Nov 05 15:11:25 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d2e6498f-eb58-4aba-8609-e9810ce14ed3 tempest-VolumesActionsTest-2062653536 None] Acquiring lock "cinder-af0fb7ba-f48e-47ed-80db-6b45f74acc2b-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d2e6498f-eb58-4aba-8609-e9810ce14ed3 tempest-VolumesActionsTest-2062653536 None] Lock "cinder-af0fb7ba-f48e-47ed-80db-6b45f74acc2b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d2e6498f-eb58-4aba-8609-e9810ce14ed3 tempest-VolumesActionsTest-2062653536 None] Acquiring lock "cinder-quobyte-af0fb7ba-f48e-47ed-80db-6b45f74acc2b" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d2e6498f-eb58-4aba-8609-e9810ce14ed3 tempest-VolumesActionsTest-2062653536 None] Lock "cinder-quobyte-af0fb7ba-f48e-47ed-80db-6b45f74acc2b" acquired by "delete_volume" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8735d4b4-6a26-4b81-9a6a-11f624819847]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d2e6498f-eb58-4aba-8609-e9810ce14ed3 tempest-VolumesActionsTest-2062653536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af0fb7ba-f48e-47ed-80db-6b45f74acc2b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:25 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5da3fe57-b120-4252-883a-28768df19888" returned: 0 in 0.393s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.478s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2085896433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c477a72e-838b-4440-b234-e27ce72c9768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fde7ba0bd2f4e7bab8ba379d6c352a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:24Z,use_quota=True,user_id='9d139cb520204951934ac5148895b694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Creating volume c477a72e-838b-4440-b234-e27ce72c9768 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:11:25 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:25 devstack sudo[96352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af0fb7ba-f48e-47ed-80db-6b45f74acc2b
Nov 05 15:11:25 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:25 devstack sudo[96354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768 1073741824
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b48d40-0ba3-4955-9962-628909eef07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5da3fe57-b120-4252-883a-28768df19888', 'volume_size': 2}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:25 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffab643a-a569-48ef-92a6-f086b0b9ddf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:25 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Volume volume-5da3fe57-b120-4252-883a-28768df19888 (5da3fe57-b120-4252-883a-28768df19888): created successfully
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffab643a-a569-48ef-92a6-f086b0b9ddf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Flow 'volume_create_manager' (0d944829-3866-4020-be3d-160dc0136992) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:11:25 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f509f918-f197-4cf2-b6fe-0b90ec336ac6 tempest-VolumesCloneNegativeTest-445037632 None] Created volume successfully.
Nov 05 15:11:26 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d2e6498f-eb58-4aba-8609-e9810ce14ed3 tempest-VolumesActionsTest-2062653536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af0fb7ba-f48e-47ed-80db-6b45f74acc2b" returned: 0 in 0.861s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d2e6498f-eb58-4aba-8609-e9810ce14ed3 tempest-VolumesActionsTest-2062653536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af0fb7ba-f48e-47ed-80db-6b45f74acc2b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:26 devstack sudo[96384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af0fb7ba-f48e-47ed-80db-6b45f74acc2b
Nov 05 15:11:26 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:26 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768 1073741824" returned: 0 in 1.077s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:27 devstack sudo[96416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768
Nov 05 15:11:27 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3e9b4222-6a83-4c3b-a086-5ee8e429e8cb tempest-VolumesCloneNegativeTest-445037632 None] Acquiring lock "cinder-5da3fe57-b120-4252-883a-28768df19888-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:11:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3e9b4222-6a83-4c3b-a086-5ee8e429e8cb tempest-VolumesCloneNegativeTest-445037632 None] Lock "cinder-5da3fe57-b120-4252-883a-28768df19888-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:11:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3e9b4222-6a83-4c3b-a086-5ee8e429e8cb tempest-VolumesCloneNegativeTest-445037632 None] Acquiring lock "cinder-quobyte-5da3fe57-b120-4252-883a-28768df19888" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:11:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3e9b4222-6a83-4c3b-a086-5ee8e429e8cb tempest-VolumesCloneNegativeTest-445037632 None] Lock "cinder-quobyte-5da3fe57-b120-4252-883a-28768df19888" acquired by "delete_volume" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:11:27 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d2e6498f-eb58-4aba-8609-e9810ce14ed3 tempest-VolumesActionsTest-2062653536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af0fb7ba-f48e-47ed-80db-6b45f74acc2b" returned: 0 in 0.837s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d2e6498f-eb58-4aba-8609-e9810ce14ed3 tempest-VolumesActionsTest-2062653536 None] Lock "cinder-quobyte-af0fb7ba-f48e-47ed-80db-6b45f74acc2b" released by "delete_volume" :: held 1.764s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:11:27 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[891babcc-e4f2-43c2-96fe-4d24728420a0]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:11:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3e9b4222-6a83-4c3b-a086-5ee8e429e8cb tempest-VolumesCloneNegativeTest-445037632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5da3fe57-b120-4252-883a-28768df19888 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:27 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-d2e6498f-eb58-4aba-8609-e9810ce14ed3 tempest-VolumesActionsTest-2062653536 None] Created reservations ['7b843cb8-0122-45b3-a4d5-d8eacd6fa9dc', '78d66e4e-d898-486a-9a6d-23e98b2ddc18', 'e1b531b5-d0cb-4336-a141-00dda4a27002', '6b0f9d19-258b-4a56-bc94-72fbce5e04f0'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:11:27 devstack sudo[96427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5da3fe57-b120-4252-883a-28768df19888
Nov 05 15:11:27 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:27 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768" returned: 0 in 0.710s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:11:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (494bd3c7-3a48-4db1-999a-b4547015fa73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c477a72e-838b-4440-b234-e27ce72c9768', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d37e1bf-fb50-429f-84f0-8c4d6a780268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:27 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Volume volume-c477a72e-838b-4440-b234-e27ce72c9768 (c477a72e-838b-4440-b234-e27ce72c9768): created successfully
Nov 05 15:11:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d37e1bf-fb50-429f-84f0-8c4d6a780268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Flow 'volume_create_manager' (6e612617-978b-4ea4-b18b-fad81f66746f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:11:27 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c82c5690-7249-4680-a6da-5580601d1249 tempest-TestStampPattern-527871853 None] Created volume successfully.
Nov 05 15:11:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d2e6498f-eb58-4aba-8609-e9810ce14ed3 tempest-VolumesActionsTest-2062653536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d2e6498f-eb58-4aba-8609-e9810ce14ed3 tempest-VolumesActionsTest-2062653536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d2e6498f-eb58-4aba-8609-e9810ce14ed3 tempest-VolumesActionsTest-2062653536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:11:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d2e6498f-eb58-4aba-8609-e9810ce14ed3 tempest-VolumesActionsTest-2062653536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:11:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d2e6498f-eb58-4aba-8609-e9810ce14ed3 tempest-VolumesActionsTest-2062653536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d2e6498f-eb58-4aba-8609-e9810ce14ed3 tempest-VolumesActionsTest-2062653536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:27 devstack sudo[96437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:11:27 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:28 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3e9b4222-6a83-4c3b-a086-5ee8e429e8cb tempest-VolumesCloneNegativeTest-445037632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5da3fe57-b120-4252-883a-28768df19888" returned: 0 in 0.997s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3e9b4222-6a83-4c3b-a086-5ee8e429e8cb tempest-VolumesCloneNegativeTest-445037632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5da3fe57-b120-4252-883a-28768df19888 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:28 devstack sudo[96446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5da3fe57-b120-4252-883a-28768df19888
Nov 05 15:11:28 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:28 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d2e6498f-eb58-4aba-8609-e9810ce14ed3 tempest-VolumesActionsTest-2062653536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.712s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:28 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-d2e6498f-eb58-4aba-8609-e9810ce14ed3 tempest-VolumesActionsTest-2062653536 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:11:28 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d2e6498f-eb58-4aba-8609-e9810ce14ed3 tempest-VolumesActionsTest-2062653536 None] Deleted volume successfully.
Nov 05 15:11:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d2e6498f-eb58-4aba-8609-e9810ce14ed3 tempest-VolumesActionsTest-2062653536 None] Lock "cinder-af0fb7ba-f48e-47ed-80db-6b45f74acc2b-delete_volume" released by "delete_volume" :: held 3.117s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:11:28 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3e9b4222-6a83-4c3b-a086-5ee8e429e8cb tempest-VolumesCloneNegativeTest-445037632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5da3fe57-b120-4252-883a-28768df19888" returned: 0 in 0.564s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3e9b4222-6a83-4c3b-a086-5ee8e429e8cb tempest-VolumesCloneNegativeTest-445037632 None] Lock "cinder-quobyte-5da3fe57-b120-4252-883a-28768df19888" released by "delete_volume" :: held 1.707s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-3e9b4222-6a83-4c3b-a086-5ee8e429e8cb tempest-VolumesCloneNegativeTest-445037632 None] Created reservations ['6418cacf-6169-48c0-ab5d-cf3f9d13e9d0', '7f853eb8-533a-4092-bcbc-79a38c755e47', 'fa99e393-750c-46e1-8cf7-8a55a0456c29', 'ae972e95-560a-46d6-93a6-86e7447a8b28'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3e9b4222-6a83-4c3b-a086-5ee8e429e8cb tempest-VolumesCloneNegativeTest-445037632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3e9b4222-6a83-4c3b-a086-5ee8e429e8cb tempest-VolumesCloneNegativeTest-445037632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3e9b4222-6a83-4c3b-a086-5ee8e429e8cb tempest-VolumesCloneNegativeTest-445037632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3e9b4222-6a83-4c3b-a086-5ee8e429e8cb tempest-VolumesCloneNegativeTest-445037632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3e9b4222-6a83-4c3b-a086-5ee8e429e8cb tempest-VolumesCloneNegativeTest-445037632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3e9b4222-6a83-4c3b-a086-5ee8e429e8cb tempest-VolumesCloneNegativeTest-445037632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:29 devstack sudo[96465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:11:29 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Flow 'volume_create_manager' (ecfe18e1-8487-409a-95cc-673b66a3bcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a2e2e43-80c7-4a04-aa51-89c3e1fc23cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a2e2e43-80c7-4a04-aa51-89c3e1fc23cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1156142692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2dc8a49-debe-4bac-bc40-99a70e747d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4148da727d46b0b38bbe7e12700ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:29Z,use_quota=True,user_id='850eca358ca4492ab97a3790837e0e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235034a6-1652-4c78-ac02-e5615b415b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235034a6-1652-4c78-ac02-e5615b415b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37bd1a9-7f1d-45d6-820e-5d1ea95b4c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37bd1a9-7f1d-45d6-820e-5d1ea95b4c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2dc8a49-debe-4bac-bc40-99a70e747d7f', 'volume_name': 'volume-c2dc8a49-debe-4bac-bc40-99a70e747d7f', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d17dc5-1437-4302-9b07-8056a8649e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d17dc5-1437-4302-9b07-8056a8649e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96783fb4-ee3d-4474-a896-1d0328b2199d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:29 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Volume c2dc8a49-debe-4bac-bc40-99a70e747d7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2dc8a49-debe-4bac-bc40-99a70e747d7f', 'volume_size': 1}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1156142692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2dc8a49-debe-4bac-bc40-99a70e747d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4148da727d46b0b38bbe7e12700ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:29Z,use_quota=True,user_id='850eca358ca4492ab97a3790837e0e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Creating volume c2dc8a49-debe-4bac-bc40-99a70e747d7f {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:11:29 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:11:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c2dc8a49-debe-4bac-bc40-99a70e747d7f 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:30 devstack sudo[96475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c2dc8a49-debe-4bac-bc40-99a70e747d7f 1073741824
Nov 05 15:11:30 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:30 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3e9b4222-6a83-4c3b-a086-5ee8e429e8cb tempest-VolumesCloneNegativeTest-445037632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.893s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:30 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-3e9b4222-6a83-4c3b-a086-5ee8e429e8cb tempest-VolumesCloneNegativeTest-445037632 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:11:30 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3e9b4222-6a83-4c3b-a086-5ee8e429e8cb tempest-VolumesCloneNegativeTest-445037632 None] Deleted volume successfully.
Nov 05 15:11:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3e9b4222-6a83-4c3b-a086-5ee8e429e8cb tempest-VolumesCloneNegativeTest-445037632 None] Lock "cinder-5da3fe57-b120-4252-883a-28768df19888-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:11:31 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c2dc8a49-debe-4bac-bc40-99a70e747d7f 1073741824" returned: 0 in 1.304s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c2dc8a49-debe-4bac-bc40-99a70e747d7f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:31 devstack sudo[96487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c2dc8a49-debe-4bac-bc40-99a70e747d7f
Nov 05 15:11:31 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:31 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c2dc8a49-debe-4bac-bc40-99a70e747d7f" returned: 0 in 0.336s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:11:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96783fb4-ee3d-4474-a896-1d0328b2199d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2dc8a49-debe-4bac-bc40-99a70e747d7f', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e3eeac-4ed4-4b52-a359-06e29892719f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:31 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Volume volume-c2dc8a49-debe-4bac-bc40-99a70e747d7f (c2dc8a49-debe-4bac-bc40-99a70e747d7f): created successfully
Nov 05 15:11:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e3eeac-4ed4-4b52-a359-06e29892719f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Flow 'volume_create_manager' (ecfe18e1-8487-409a-95cc-673b66a3bcb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:11:31 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-8449b311-5fc1-41b5-a11e-7bd1417bf637 tempest-VolumesActionsTest-1533429368 None] Created volume successfully.
Nov 05 15:11:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e792a4b1-3499-492e-bd30-ba1428bd0c65 tempest-VolumesActionsTest-1533429368 None] Acquiring lock "cinder-c2dc8a49-debe-4bac-bc40-99a70e747d7f-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:11:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e792a4b1-3499-492e-bd30-ba1428bd0c65 tempest-VolumesActionsTest-1533429368 None] Lock "cinder-c2dc8a49-debe-4bac-bc40-99a70e747d7f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:11:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e792a4b1-3499-492e-bd30-ba1428bd0c65 tempest-VolumesActionsTest-1533429368 None] Acquiring lock "cinder-quobyte-c2dc8a49-debe-4bac-bc40-99a70e747d7f" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:11:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e792a4b1-3499-492e-bd30-ba1428bd0c65 tempest-VolumesActionsTest-1533429368 None] Lock "cinder-quobyte-c2dc8a49-debe-4bac-bc40-99a70e747d7f" acquired by "delete_volume" :: waited 0.057s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:11:33 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8174ab5-7fdd-4aa2-9c58-c0b57ade39fe]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:11:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e792a4b1-3499-492e-bd30-ba1428bd0c65 tempest-VolumesActionsTest-1533429368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c2dc8a49-debe-4bac-bc40-99a70e747d7f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:34 devstack sudo[96504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c2dc8a49-debe-4bac-bc40-99a70e747d7f
Nov 05 15:11:34 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:34 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e792a4b1-3499-492e-bd30-ba1428bd0c65 tempest-VolumesActionsTest-1533429368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c2dc8a49-debe-4bac-bc40-99a70e747d7f" returned: 0 in 0.996s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e792a4b1-3499-492e-bd30-ba1428bd0c65 tempest-VolumesActionsTest-1533429368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c2dc8a49-debe-4bac-bc40-99a70e747d7f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:35 devstack sudo[96551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c2dc8a49-debe-4bac-bc40-99a70e747d7f
Nov 05 15:11:35 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:35 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e792a4b1-3499-492e-bd30-ba1428bd0c65 tempest-VolumesActionsTest-1533429368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c2dc8a49-debe-4bac-bc40-99a70e747d7f" returned: 0 in 0.634s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e792a4b1-3499-492e-bd30-ba1428bd0c65 tempest-VolumesActionsTest-1533429368 None] Lock "cinder-quobyte-c2dc8a49-debe-4bac-bc40-99a70e747d7f" released by "delete_volume" :: held 1.807s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:11:35 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-e792a4b1-3499-492e-bd30-ba1428bd0c65 tempest-VolumesActionsTest-1533429368 None] Created reservations ['b39137e1-a02e-41e9-8085-b97a7624dd6e', 'badbe7fb-bf61-44f2-b265-1699b21440e1', '7de59a77-77c0-49f4-b250-6110028b2257', '91e6bbcd-6346-45f2-bbc2-a5fc6f99a075'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:11:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e792a4b1-3499-492e-bd30-ba1428bd0c65 tempest-VolumesActionsTest-1533429368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e792a4b1-3499-492e-bd30-ba1428bd0c65 tempest-VolumesActionsTest-1533429368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e792a4b1-3499-492e-bd30-ba1428bd0c65 tempest-VolumesActionsTest-1533429368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:11:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e792a4b1-3499-492e-bd30-ba1428bd0c65 tempest-VolumesActionsTest-1533429368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:11:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e792a4b1-3499-492e-bd30-ba1428bd0c65 tempest-VolumesActionsTest-1533429368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e792a4b1-3499-492e-bd30-ba1428bd0c65 tempest-VolumesActionsTest-1533429368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:35 devstack sudo[96567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:11:35 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:36 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e792a4b1-3499-492e-bd30-ba1428bd0c65 tempest-VolumesActionsTest-1533429368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.621s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:36 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-e792a4b1-3499-492e-bd30-ba1428bd0c65 tempest-VolumesActionsTest-1533429368 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:11:36 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e792a4b1-3499-492e-bd30-ba1428bd0c65 tempest-VolumesActionsTest-1533429368 None] Deleted volume successfully.
Nov 05 15:11:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e792a4b1-3499-492e-bd30-ba1428bd0c65 tempest-VolumesActionsTest-1533429368 None] Lock "cinder-c2dc8a49-debe-4bac-bc40-99a70e747d7f-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:11:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:11:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:11:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:11:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:37 devstack sudo[96573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:11:37 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:37 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.519s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:11:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:11:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 15:11:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread info: [<_MainThread(MainThread, started 136317437956224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136317326340928)>, <Thread(Thread-3 (stat_writer), started daemon 136317326487936)>, <Thread(Rabbit-heartbeat, started daemon 136317321464000)>, <Thread(Thread-5 (_runner), started daemon 136317321550592)>, <Thread(Thread-7 (_runner), started daemon 136317321658496)>, <Thread(fd_logger, started daemon 136317319612992)>, <Thread(privsep_reader, started daemon 136317319622400)>, <Thread(tpool_thread_0, started daemon 136317310928576)>, <Thread(tpool_thread_1, started daemon 136317302535872)>, <Thread(tpool_thread_2, started daemon 136317294143168)>, <Thread(tpool_thread_3, started daemon 136317285750464)>, <Thread(tpool_thread_4, started daemon 136317277357760)>, <Thread(tpool_thread_5, started daemon 136317268965056)>, <Thread(tpool_thread_6, started daemon 136317260572352)>, <Thread(tpool_thread_7, started daemon 136317252179648)>, <Thread(tpool_thread_8, started daemon 136317243786944)>, <Thread(tpool_thread_9, started daemon 136317235394240)>, <Thread(tpool_thread_10, started daemon 136317227001536)>, <Thread(tpool_thread_11, started daemon 136317218608832)>, <Thread(tpool_thread_12, started daemon 136317210216128)>, <Thread(tpool_thread_13, started daemon 136317201807040)>, <Thread(tpool_thread_14, started daemon 136317193397952)>, <Thread(tpool_thread_15, started daemon 136317184988864)>, <Thread(tpool_thread_16, started daemon 136317176579776)>, <Thread(tpool_thread_17, started daemon 136317168170688)>, <Thread(tpool_thread_18, started daemon 136317159761600)>, <Thread(tpool_thread_19, started daemon 136317151352512)>] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 15:11:39 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:11:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Flow 'volume_create_manager' (cbc5ce51-2142-4bc1-ab62-b0e099ecaabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:11:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1fffb6-0489-4143-98e8-4bce5d7d8431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1fffb6-0489-4143-98e8-4bce5d7d8431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1434816587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b332b7e-e57d-4820-b5e6-153135551918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d37f2dadd7da43c9895361923adf4910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:40Z,use_quota=True,user_id='df2b8fe9e8bc4b2092ac6031702bd134',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859cb36a-6246-46e3-b485-1ca2bd099888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859cb36a-6246-46e3-b485-1ca2bd099888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d289386-bfed-43be-b825-56ff5bc46411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:39 devstack cinder-volume[87150]: DEBUG cinder.image.glance [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Creating Keystone auth plugin from conf {{(pid=87150) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 15:11:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d289386-bfed-43be-b825-56ff5bc46411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7b332b7e-e57d-4820-b5e6-153135551918', 'volume_name': 'volume-7b332b7e-e57d-4820-b5e6-153135551918', 'volume_size': 1, 'image_id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4a6a2406cd83415e894eebbb1d6b51ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'created_at': datetime.datetime(2026, 11, 5, 13, 57, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21a5d804-2425-4adb-8e07-60d978b4be84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfaced33e00>}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdcd07ef-9dc9-4987-9f86-6e167a80c185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdcd07ef-9dc9-4987-9f86-6e167a80c185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c3e495-de1f-4ecf-a665-5b7b636dec60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:40 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Volume 7b332b7e-e57d-4820-b5e6-153135551918: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7b332b7e-e57d-4820-b5e6-153135551918', 'volume_size': 1, 'image_id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4a6a2406cd83415e894eebbb1d6b51ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'created_at': datetime.datetime(2026, 11, 5, 13, 57, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21a5d804-2425-4adb-8e07-60d978b4be84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfaced33e00>}
Nov 05 15:11:40 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Trying to clone 7b332b7e-e57d-4820-b5e6-153135551918 from image 21a5d804-2425-4adb-8e07-60d978b4be84 at location (None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}]). {{(pid=87150) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 15:11:41 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_q1po2f04devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 15:11:41 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 15:11:41 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ca50c1-3587-49b7-a53b-fc68e62d937f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:11:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_q1po2f04devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:41 devstack sudo[96579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_q1po2f04devstack@QuobyteHD
Nov 05 15:11:41 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:41 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_q1po2f04devstack@QuobyteHD" returned: 0 in 0.381s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:41 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Temporary image 21a5d804-2425-4adb-8e07-60d978b4be84 is fetched for user df2b8fe9e8bc4b2092ac6031702bd134. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 15:11:41 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b1c004-1813-440d-8747-9bd3b5ae94e8]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:11:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_q1po2f04devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:41 devstack sudo[96605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_q1po2f04devstack@QuobyteHD
Nov 05 15:11:41 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:42 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_q1po2f04devstack@QuobyteHD" returned: 0 in 0.474s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1434816587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b332b7e-e57d-4820-b5e6-153135551918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d37f2dadd7da43c9895361923adf4910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:40Z,use_quota=True,user_id='df2b8fe9e8bc4b2092ac6031702bd134',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:11:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Creating volume 7b332b7e-e57d-4820-b5e6-153135551918 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:11:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:11:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:11:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:11:42 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:11:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7b332b7e-e57d-4820-b5e6-153135551918 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:42 devstack sudo[96610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7b332b7e-e57d-4820-b5e6-153135551918 1073741824
Nov 05 15:11:42 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:42 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7b332b7e-e57d-4820-b5e6-153135551918 1073741824" returned: 0 in 0.642s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7b332b7e-e57d-4820-b5e6-153135551918 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:42 devstack sudo[96617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7b332b7e-e57d-4820-b5e6-153135551918
Nov 05 15:11:42 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:43 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7b332b7e-e57d-4820-b5e6-153135551918" returned: 0 in 0.442s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:11:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:43 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Attempting download of 21a5d804-2425-4adb-8e07-60d978b4be84 ((None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}])) to volume 7b332b7e-e57d-4820-b5e6-153135551918. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 15:11:43 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[153f1ec1-6c82-47b6-bbb6-ec7ca93ac707]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:11:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_v_ozsxrb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:43 devstack sudo[96622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_v_ozsxrb
Nov 05 15:11:43 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:43 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_v_ozsxrb" returned: 0 in 0.453s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_v_ozsxrb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:44 devstack sudo[96626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_v_ozsxrb
Nov 05 15:11:44 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:44 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_v_ozsxrb" returned: 1 in 0.435s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_v_ozsxrb' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 15:11:44 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4d773a-5b5d-4c5c-9177-1f0be00d2bf5]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:11:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_q1po2f04devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:44 devstack sudo[96630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_q1po2f04devstack@QuobyteHD
Nov 05 15:11:44 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:44 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_q1po2f04devstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:44 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] 21a5d804-2425-4adb-8e07-60d978b4be84 was qcow2, converting to qcow2 {{(pid=87150) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 15:11:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_q1po2f04devstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7b332b7e-e57d-4820-b5e6-153135551918 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:44 devstack sudo[96635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_q1po2f04devstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7b332b7e-e57d-4820-b5e6-153135551918
Nov 05 15:11:44 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:46 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_q1po2f04devstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7b332b7e-e57d-4820-b5e6-153135551918" returned: 0 in 2.048s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:46 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_q1po2f04devstack@QuobyteHD, size 112.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7b332b7e-e57d-4820-b5e6-153135551918 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:11:46 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Converted 112.00 MB image at 54.65 MB/s
Nov 05 15:11:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7b332b7e-e57d-4820-b5e6-153135551918 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:46 devstack sudo[96644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7b332b7e-e57d-4820-b5e6-153135551918 1G
Nov 05 15:11:46 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:47 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7b332b7e-e57d-4820-b5e6-153135551918 1G" returned: 0 in 0.324s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:47 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Downloaded image 21a5d804-2425-4adb-8e07-60d978b4be84 ((None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}])) to volume 7b332b7e-e57d-4820-b5e6-153135551918 successfully. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 15:11:47 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Temporary image 21a5d804-2425-4adb-8e07-60d978b4be84 for user df2b8fe9e8bc4b2092ac6031702bd134 is deleted. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 15:11:47 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Marking volume 7b332b7e-e57d-4820-b5e6-153135551918 as bootable. {{(pid=87150) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 15:11:47 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Copying metadata from image 21a5d804-2425-4adb-8e07-60d978b4be84 to 7b332b7e-e57d-4820-b5e6-153135551918. {{(pid=87150) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 15:11:47 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Creating volume glance metadata for volume 7b332b7e-e57d-4820-b5e6-153135551918 backed by image 21a5d804-2425-4adb-8e07-60d978b4be84 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87150) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 15:11:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c3e495-de1f-4ecf-a665-5b7b636dec60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b332b7e-e57d-4820-b5e6-153135551918', 'volume_size': 1, 'image_id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4a6a2406cd83415e894eebbb1d6b51ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'created_at': datetime.datetime(2026, 11, 5, 13, 57, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21a5d804-2425-4adb-8e07-60d978b4be84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfaced33e00>}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e33bf23-841c-45a1-b51d-216855464607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:47 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Volume volume-7b332b7e-e57d-4820-b5e6-153135551918 (7b332b7e-e57d-4820-b5e6-153135551918): created successfully
Nov 05 15:11:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e33bf23-841c-45a1-b51d-216855464607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Flow 'volume_create_manager' (cbc5ce51-2142-4bc1-ab62-b0e099ecaabd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:11:47 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c2113127-e9de-4ac2-9753-d1e7c3bc5dfb tempest-VolumesExtendTest-1719333140 None] Created volume successfully.
Nov 05 15:11:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1c2a71f8-4531-4396-b552-fb95ed5318cc tempest-VolumesExtendTest-1719333140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1c2a71f8-4531-4396-b552-fb95ed5318cc tempest-VolumesExtendTest-1719333140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:48 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b5a16c-8101-44f4-99e8-b45034b7a65b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:11:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1c2a71f8-4531-4396-b552-fb95ed5318cc tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7b332b7e-e57d-4820-b5e6-153135551918 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:48 devstack sudo[96652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7b332b7e-e57d-4820-b5e6-153135551918
Nov 05 15:11:48 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:49 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1c2a71f8-4531-4396-b552-fb95ed5318cc tempest-VolumesExtendTest-1719333140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7b332b7e-e57d-4820-b5e6-153135551918" returned: 0 in 0.460s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1c2a71f8-4531-4396-b552-fb95ed5318cc tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7b332b7e-e57d-4820-b5e6-153135551918 2G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1c2a71f8-4531-4396-b552-fb95ed5318cc tempest-VolumesExtendTest-1719333140 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7b332b7e-e57d-4820-b5e6-153135551918 2G" returned: 0 in 0.141s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1c2a71f8-4531-4396-b552-fb95ed5318cc tempest-VolumesExtendTest-1719333140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.641s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:49 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1c2a71f8-4531-4396-b552-fb95ed5318cc tempest-VolumesExtendTest-1719333140 None] Extend volume completed successfully.
Nov 05 15:11:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-66c0093b-4c3d-4870-8f7f-5b40ac82829c tempest-VolumesExtendTest-1719333140 None] Acquiring lock "cinder-7b332b7e-e57d-4820-b5e6-153135551918-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:11:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-66c0093b-4c3d-4870-8f7f-5b40ac82829c tempest-VolumesExtendTest-1719333140 None] Lock "cinder-7b332b7e-e57d-4820-b5e6-153135551918-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:11:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-66c0093b-4c3d-4870-8f7f-5b40ac82829c tempest-VolumesExtendTest-1719333140 None] Acquiring lock "cinder-quobyte-7b332b7e-e57d-4820-b5e6-153135551918" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:11:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-66c0093b-4c3d-4870-8f7f-5b40ac82829c tempest-VolumesExtendTest-1719333140 None] Lock "cinder-quobyte-7b332b7e-e57d-4820-b5e6-153135551918" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:11:50 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3e3ddd-d50e-433d-b959-01df3b6004bd]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:11:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-66c0093b-4c3d-4870-8f7f-5b40ac82829c tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7b332b7e-e57d-4820-b5e6-153135551918 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:50 devstack sudo[96686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7b332b7e-e57d-4820-b5e6-153135551918
Nov 05 15:11:50 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:51 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-66c0093b-4c3d-4870-8f7f-5b40ac82829c tempest-VolumesExtendTest-1719333140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7b332b7e-e57d-4820-b5e6-153135551918" returned: 0 in 0.405s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-66c0093b-4c3d-4870-8f7f-5b40ac82829c tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7b332b7e-e57d-4820-b5e6-153135551918 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:51 devstack sudo[96692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7b332b7e-e57d-4820-b5e6-153135551918
Nov 05 15:11:51 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:51 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-66c0093b-4c3d-4870-8f7f-5b40ac82829c tempest-VolumesExtendTest-1719333140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7b332b7e-e57d-4820-b5e6-153135551918" returned: 0 in 0.275s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-66c0093b-4c3d-4870-8f7f-5b40ac82829c tempest-VolumesExtendTest-1719333140 None] Lock "cinder-quobyte-7b332b7e-e57d-4820-b5e6-153135551918" released by "delete_volume" :: held 0.729s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:11:51 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-66c0093b-4c3d-4870-8f7f-5b40ac82829c tempest-VolumesExtendTest-1719333140 None] Created reservations ['4fcd9e36-bc00-4561-948e-e15b4cbd3a5d', 'c0b0aac8-1173-4fb8-8d38-c249ea2bfe0a', '296730e2-2727-4ae3-92c3-826dd22b079b', '3c4b5de3-2210-4346-9278-af6021944579'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:11:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-66c0093b-4c3d-4870-8f7f-5b40ac82829c tempest-VolumesExtendTest-1719333140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-66c0093b-4c3d-4870-8f7f-5b40ac82829c tempest-VolumesExtendTest-1719333140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-66c0093b-4c3d-4870-8f7f-5b40ac82829c tempest-VolumesExtendTest-1719333140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:11:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-66c0093b-4c3d-4870-8f7f-5b40ac82829c tempest-VolumesExtendTest-1719333140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:11:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-66c0093b-4c3d-4870-8f7f-5b40ac82829c tempest-VolumesExtendTest-1719333140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-66c0093b-4c3d-4870-8f7f-5b40ac82829c tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:51 devstack sudo[96695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:11:51 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:51 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-66c0093b-4c3d-4870-8f7f-5b40ac82829c tempest-VolumesExtendTest-1719333140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.275s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:51 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-66c0093b-4c3d-4870-8f7f-5b40ac82829c tempest-VolumesExtendTest-1719333140 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:11:51 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-66c0093b-4c3d-4870-8f7f-5b40ac82829c tempest-VolumesExtendTest-1719333140 None] Deleted volume successfully.
Nov 05 15:11:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-66c0093b-4c3d-4870-8f7f-5b40ac82829c tempest-VolumesExtendTest-1719333140 None] Lock "cinder-7b332b7e-e57d-4820-b5e6-153135551918-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Flow 'volume_create_manager' (f648f5ab-d5ff-423a-be50-01144ba0df9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae1a191-b9f9-416e-87f3-8b8e8d32b776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae1a191-b9f9-416e-87f3-8b8e8d32b776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1241681748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07045dde-1a36-4fb4-b421-1e3379ed01f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d37f2dadd7da43c9895361923adf4910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:52Z,use_quota=True,user_id='df2b8fe9e8bc4b2092ac6031702bd134',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e73a5740-795e-47b1-9f84-f718cf248e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e73a5740-795e-47b1-9f84-f718cf248e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866d458b-4806-45c6-a655-0bd2148ccecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866d458b-4806-45c6-a655-0bd2148ccecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07045dde-1a36-4fb4-b421-1e3379ed01f3', 'volume_name': 'volume-07045dde-1a36-4fb4-b421-1e3379ed01f3', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3409131d-4196-4b86-a08a-f10fa3321436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3409131d-4196-4b86-a08a-f10fa3321436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54eca4b-3fe8-46b3-8509-2e2c8d023aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:52 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Volume 07045dde-1a36-4fb4-b421-1e3379ed01f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07045dde-1a36-4fb4-b421-1e3379ed01f3', 'volume_size': 1}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1241681748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07045dde-1a36-4fb4-b421-1e3379ed01f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d37f2dadd7da43c9895361923adf4910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:52Z,use_quota=True,user_id='df2b8fe9e8bc4b2092ac6031702bd134',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Creating volume 07045dde-1a36-4fb4-b421-1e3379ed01f3 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:11:52 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:52 devstack sudo[96704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3 1073741824
Nov 05 15:11:52 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Flow 'volume_create_manager' (6e7d8afb-afdc-45fd-9901-539ca38e1ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d32ae89a-2cbd-4d2d-8c53-26f0d9435f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d32ae89a-2cbd-4d2d-8c53-26f0d9435f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1440197402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9190ad5e-d8a4-4a16-8b50-96b59ebcb793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fd20ae1aa294c28b636ce3d7164172f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:53Z,use_quota=True,user_id='bcd28db31e9946e38e806fbfffa2bc0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48a62e5-20a2-4290-92e6-d1574eb90d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48a62e5-20a2-4290-92e6-d1574eb90d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e36606-0c8e-4a35-b2d5-93a252d7c0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e36606-0c8e-4a35-b2d5-93a252d7c0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9190ad5e-d8a4-4a16-8b50-96b59ebcb793', 'volume_name': 'volume-9190ad5e-d8a4-4a16-8b50-96b59ebcb793', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c93948-965d-4f21-8b3a-ea0c29bf678d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c93948-965d-4f21-8b3a-ea0c29bf678d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d69b55-0734-4e98-a609-310c83468c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:52 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Volume 9190ad5e-d8a4-4a16-8b50-96b59ebcb793: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9190ad5e-d8a4-4a16-8b50-96b59ebcb793', 'volume_size': 1}
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:52 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3 1073741824" returned: 0 in 0.584s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:53 devstack sudo[96710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3
Nov 05 15:11:53 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:53 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3" returned: 0 in 0.265s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:11:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.326s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1440197402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9190ad5e-d8a4-4a16-8b50-96b59ebcb793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fd20ae1aa294c28b636ce3d7164172f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:53Z,use_quota=True,user_id='bcd28db31e9946e38e806fbfffa2bc0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:11:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Creating volume 9190ad5e-d8a4-4a16-8b50-96b59ebcb793 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:11:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:11:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:11:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:11:53 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:11:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9190ad5e-d8a4-4a16-8b50-96b59ebcb793 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54eca4b-3fe8-46b3-8509-2e2c8d023aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07045dde-1a36-4fb4-b421-1e3379ed01f3', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:53 devstack sudo[96713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9190ad5e-d8a4-4a16-8b50-96b59ebcb793 1073741824
Nov 05 15:11:53 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43ca0260-374d-4ad0-a57b-a9029a4b55b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:53 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Volume volume-07045dde-1a36-4fb4-b421-1e3379ed01f3 (07045dde-1a36-4fb4-b421-1e3379ed01f3): created successfully
Nov 05 15:11:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43ca0260-374d-4ad0-a57b-a9029a4b55b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Flow 'volume_create_manager' (f648f5ab-d5ff-423a-be50-01144ba0df9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:11:53 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-25b99a3b-96c7-4c98-be3a-b1fd84acbe0f tempest-VolumesExtendTest-1719333140 None] Created volume successfully.
Nov 05 15:11:53 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9190ad5e-d8a4-4a16-8b50-96b59ebcb793 1073741824" returned: 0 in 0.464s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9190ad5e-d8a4-4a16-8b50-96b59ebcb793 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:53 devstack sudo[96719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9190ad5e-d8a4-4a16-8b50-96b59ebcb793
Nov 05 15:11:53 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:54 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9190ad5e-d8a4-4a16-8b50-96b59ebcb793" returned: 0 in 0.260s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:11:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d69b55-0734-4e98-a609-310c83468c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9190ad5e-d8a4-4a16-8b50-96b59ebcb793', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5448775-e1ba-41a9-906a-8d978b4f39c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:11:54 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Volume volume-9190ad5e-d8a4-4a16-8b50-96b59ebcb793 (9190ad5e-d8a4-4a16-8b50-96b59ebcb793): created successfully
Nov 05 15:11:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5448775-e1ba-41a9-906a-8d978b4f39c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:11:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Flow 'volume_create_manager' (6e7d8afb-afdc-45fd-9901-539ca38e1ecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:11:54 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c0ea951c-26ba-42d7-a907-1a3ce2c86f34 tempest-AttachVolumeTestJSON-2065852907 None] Created volume successfully.
Nov 05 15:11:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-098726f4-4e33-4b15-bfdd-3adf4463bb73 tempest-VolumesExtendTest-1719333140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-098726f4-4e33-4b15-bfdd-3adf4463bb73 tempest-VolumesExtendTest-1719333140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-098726f4-4e33-4b15-bfdd-3adf4463bb73 tempest-VolumesExtendTest-1719333140 None] Creating offline snapshot 8570af00-9edd-4818-a344-f6b604e6abc6 of volume 07045dde-1a36-4fb4-b421-1e3379ed01f3 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:11:54 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bf9c3b-d782-40be-87bd-37818d5e7b7e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:11:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-098726f4-4e33-4b15-bfdd-3adf4463bb73 tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:54 devstack sudo[96722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3
Nov 05 15:11:54 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:55 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-098726f4-4e33-4b15-bfdd-3adf4463bb73 tempest-VolumesExtendTest-1719333140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3" returned: 0 in 0.407s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-098726f4-4e33-4b15-bfdd-3adf4463bb73 tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.8570af00-9edd-4818-a344-f6b604e6abc6 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:55 devstack sudo[96731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.8570af00-9edd-4818-a344-f6b604e6abc6 1G
Nov 05 15:11:55 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:55 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-098726f4-4e33-4b15-bfdd-3adf4463bb73 tempest-VolumesExtendTest-1719333140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.8570af00-9edd-4818-a344-f6b604e6abc6 1G" returned: 0 in 0.510s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-098726f4-4e33-4b15-bfdd-3adf4463bb73 tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07045dde-1a36-4fb4-b421-1e3379ed01f3 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.8570af00-9edd-4818-a344-f6b604e6abc6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:55 devstack sudo[96740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07045dde-1a36-4fb4-b421-1e3379ed01f3 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.8570af00-9edd-4818-a344-f6b604e6abc6
Nov 05 15:11:55 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-d6b4318e-893a-4596-b111-e363cec18d62 req-39e83f86-6964-4551-81ff-c7ee0f11e5ae tempest-AttachVolumeTestJSON-2065852907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:56 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-098726f4-4e33-4b15-bfdd-3adf4463bb73 tempest-VolumesExtendTest-1719333140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07045dde-1a36-4fb4-b421-1e3379ed01f3 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.8570af00-9edd-4818-a344-f6b604e6abc6" returned: 0 in 0.436s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:56 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-098726f4-4e33-4b15-bfdd-3adf4463bb73 tempest-VolumesExtendTest-1719333140 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.8570af00-9edd-4818-a344-f6b604e6abc6 is being set with open permissions: ugo+rw
Nov 05 15:11:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-098726f4-4e33-4b15-bfdd-3adf4463bb73 tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.8570af00-9edd-4818-a344-f6b604e6abc6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:56 devstack sudo[96752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.8570af00-9edd-4818-a344-f6b604e6abc6
Nov 05 15:11:56 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:56 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-098726f4-4e33-4b15-bfdd-3adf4463bb73 tempest-VolumesExtendTest-1719333140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.8570af00-9edd-4818-a344-f6b604e6abc6" returned: 0 in 0.261s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-098726f4-4e33-4b15-bfdd-3adf4463bb73 tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:56 devstack sudo[96755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.info
Nov 05 15:11:56 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:56 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-098726f4-4e33-4b15-bfdd-3adf4463bb73 tempest-VolumesExtendTest-1719333140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.info" returned: 0 in 0.254s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:56 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-098726f4-4e33-4b15-bfdd-3adf4463bb73 tempest-VolumesExtendTest-1719333140 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.info is being set with open permissions: ugo+rw
Nov 05 15:11:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-098726f4-4e33-4b15-bfdd-3adf4463bb73 tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:56 devstack sudo[96758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.info
Nov 05 15:11:56 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:56 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-098726f4-4e33-4b15-bfdd-3adf4463bb73 tempest-VolumesExtendTest-1719333140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.info" returned: 0 in 0.289s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-098726f4-4e33-4b15-bfdd-3adf4463bb73 tempest-VolumesExtendTest-1719333140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.255s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-d6b4318e-893a-4596-b111-e363cec18d62 req-39e83f86-6964-4551-81ff-c7ee0f11e5ae tempest-AttachVolumeTestJSON-2065852907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.066s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-d6b4318e-893a-4596-b111-e363cec18d62 req-39e83f86-6964-4551-81ff-c7ee0f11e5ae tempest-AttachVolumeTestJSON-2065852907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:56 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-098726f4-4e33-4b15-bfdd-3adf4463bb73 tempest-VolumesExtendTest-1719333140 None] Create snapshot completed successfully
Nov 05 15:11:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-d6b4318e-893a-4596-b111-e363cec18d62 req-39e83f86-6964-4551-81ff-c7ee0f11e5ae tempest-AttachVolumeTestJSON-2065852907 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628', 'name': 'volume-9190ad5e-d8a4-4a16-8b50-96b59ebcb793', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '526312fd-50c9-4ecc-b702-f9bc28d7d9cf', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 15:11:57 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-d6b4318e-893a-4596-b111-e363cec18d62 req-39e83f86-6964-4551-81ff-c7ee0f11e5ae tempest-AttachVolumeTestJSON-2065852907 None] attachment_update completed successfully.
Nov 05 15:11:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-564712e0-cc7e-409e-be7d-ba793fac351e tempest-VolumesExtendTest-1719333140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:11:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-564712e0-cc7e-409e-be7d-ba793fac351e tempest-VolumesExtendTest-1719333140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:11:58 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[526290ee-dfad-4984-aa05-0ab132bc905b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:11:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-564712e0-cc7e-409e-be7d-ba793fac351e tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:58 devstack sudo[97176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3
Nov 05 15:11:58 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:58 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-564712e0-cc7e-409e-be7d-ba793fac351e tempest-VolumesExtendTest-1719333140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3" returned: 0 in 0.420s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-564712e0-cc7e-409e-be7d-ba793fac351e tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.8570af00-9edd-4818-a344-f6b604e6abc6 2G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-564712e0-cc7e-409e-be7d-ba793fac351e tempest-VolumesExtendTest-1719333140 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.8570af00-9edd-4818-a344-f6b604e6abc6 2G" returned: 0 in 0.149s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-564712e0-cc7e-409e-be7d-ba793fac351e tempest-VolumesExtendTest-1719333140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.612s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:11:58 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-564712e0-cc7e-409e-be7d-ba793fac351e tempest-VolumesExtendTest-1719333140 None] Extend volume completed successfully.
Nov 05 15:11:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4060d72a-711c-4c03-bb94-d8ebe565d393 tempest-VolumesExtendTest-1719333140 None] Acquiring lock "cinder-8570af00-9edd-4818-a344-f6b604e6abc6-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:11:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4060d72a-711c-4c03-bb94-d8ebe565d393 tempest-VolumesExtendTest-1719333140 None] Lock "cinder-8570af00-9edd-4818-a344-f6b604e6abc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:11:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4060d72a-711c-4c03-bb94-d8ebe565d393 tempest-VolumesExtendTest-1719333140 None] Acquiring lock "cinder-quobyte-07045dde-1a36-4fb4-b421-1e3379ed01f3" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:11:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4060d72a-711c-4c03-bb94-d8ebe565d393 tempest-VolumesExtendTest-1719333140 None] Lock "cinder-quobyte-07045dde-1a36-4fb4-b421-1e3379ed01f3" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:11:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4060d72a-711c-4c03-bb94-d8ebe565d393 tempest-VolumesExtendTest-1719333140 None] Acquiring lock "cinder-quobyte-8570af00-9edd-4818-a344-f6b604e6abc6" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:11:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4060d72a-711c-4c03-bb94-d8ebe565d393 tempest-VolumesExtendTest-1719333140 None] Lock "cinder-quobyte-8570af00-9edd-4818-a344-f6b604e6abc6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:11:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4060d72a-711c-4c03-bb94-d8ebe565d393 tempest-VolumesExtendTest-1719333140 None] Deleting offline snapshot 8570af00-9edd-4818-a344-f6b604e6abc6 of volume 07045dde-1a36-4fb4-b421-1e3379ed01f3 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:11:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4060d72a-711c-4c03-bb94-d8ebe565d393 tempest-VolumesExtendTest-1719333140 None] snapshot_file for this snap is: volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.8570af00-9edd-4818-a344-f6b604e6abc6 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:11:59 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbb3d2c-17c7-495c-90cc-1b59f2d6ec6f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:11:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4060d72a-711c-4c03-bb94-d8ebe565d393 tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.8570af00-9edd-4818-a344-f6b604e6abc6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:11:59 devstack sudo[97188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.8570af00-9edd-4818-a344-f6b604e6abc6
Nov 05 15:11:59 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:11:59 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root
Nov 05 15:11:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4060d72a-711c-4c03-bb94-d8ebe565d393 tempest-VolumesExtendTest-1719333140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.8570af00-9edd-4818-a344-f6b604e6abc6" returned: 0 in 0.419s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:11:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4060d72a-711c-4c03-bb94-d8ebe565d393 tempest-VolumesExtendTest-1719333140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07045dde-1a36-4fb4-b421-1e3379ed01f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:11:59 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[151e255c-2387-47a3-be92-9df673d69867]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:11:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4060d72a-711c-4c03-bb94-d8ebe565d393 tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:00 devstack sudo[97197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3
Nov 05 15:12:00 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:00 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4060d72a-711c-4c03-bb94-d8ebe565d393 tempest-VolumesExtendTest-1719333140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3" returned: 0 in 0.392s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4060d72a-711c-4c03-bb94-d8ebe565d393 tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.8570af00-9edd-4818-a344-f6b604e6abc6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:00 devstack sudo[97202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.8570af00-9edd-4818-a344-f6b604e6abc6
Nov 05 15:12:00 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:00 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4060d72a-711c-4c03-bb94-d8ebe565d393 tempest-VolumesExtendTest-1719333140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.8570af00-9edd-4818-a344-f6b604e6abc6" returned: 0 in 0.414s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4060d72a-711c-4c03-bb94-d8ebe565d393 tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.8570af00-9edd-4818-a344-f6b604e6abc6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:00 devstack sudo[97207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.8570af00-9edd-4818-a344-f6b604e6abc6
Nov 05 15:12:00 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:01 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4060d72a-711c-4c03-bb94-d8ebe565d393 tempest-VolumesExtendTest-1719333140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3.8570af00-9edd-4818-a344-f6b604e6abc6" returned: 0 in 0.277s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4060d72a-711c-4c03-bb94-d8ebe565d393 tempest-VolumesExtendTest-1719333140 None] Lock "cinder-quobyte-8570af00-9edd-4818-a344-f6b604e6abc6" released by "_delete_snapshot" :: held 1.659s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:12:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4060d72a-711c-4c03-bb94-d8ebe565d393 tempest-VolumesExtendTest-1719333140 None] Lock "cinder-quobyte-07045dde-1a36-4fb4-b421-1e3379ed01f3" released by "delete_snapshot" :: held 1.689s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:12:01 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-4060d72a-711c-4c03-bb94-d8ebe565d393 tempest-VolumesExtendTest-1719333140 None] Created reservations ['0d5a4204-31cf-4876-99df-337ea5a2ad94', 'faad2edb-4930-4363-b406-be52d4eca6e5', '39a7a2ba-67b5-41bb-8f34-6f4ec9ce2ecf', '6021d764-751c-4d57-806a-254959905bc0'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:12:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4060d72a-711c-4c03-bb94-d8ebe565d393 tempest-VolumesExtendTest-1719333140 None] Delete snapshot completed successfully.
Nov 05 15:12:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4060d72a-711c-4c03-bb94-d8ebe565d393 tempest-VolumesExtendTest-1719333140 None] Lock "cinder-8570af00-9edd-4818-a344-f6b604e6abc6-delete_snapshot" released by "delete_snapshot" :: held 1.900s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:12:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c8b966b7-ba99-4f3f-841b-c580001bcc0c tempest-VolumesExtendTest-1719333140 None] Acquiring lock "cinder-07045dde-1a36-4fb4-b421-1e3379ed01f3-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:12:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c8b966b7-ba99-4f3f-841b-c580001bcc0c tempest-VolumesExtendTest-1719333140 None] Lock "cinder-07045dde-1a36-4fb4-b421-1e3379ed01f3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:12:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c8b966b7-ba99-4f3f-841b-c580001bcc0c tempest-VolumesExtendTest-1719333140 None] Acquiring lock "cinder-quobyte-07045dde-1a36-4fb4-b421-1e3379ed01f3" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:12:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c8b966b7-ba99-4f3f-841b-c580001bcc0c tempest-VolumesExtendTest-1719333140 None] Lock "cinder-quobyte-07045dde-1a36-4fb4-b421-1e3379ed01f3" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:12:01 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5a16c0-aa71-4bc6-bc62-6d495a61013d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:12:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c8b966b7-ba99-4f3f-841b-c580001bcc0c tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:01 devstack sudo[97210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3
Nov 05 15:12:01 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:02 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c8b966b7-ba99-4f3f-841b-c580001bcc0c tempest-VolumesExtendTest-1719333140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3" returned: 0 in 0.698s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c8b966b7-ba99-4f3f-841b-c580001bcc0c tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:02 devstack sudo[97332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3
Nov 05 15:12:02 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:02 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:12:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Flow 'volume_create_manager' (44b8cb6c-d14f-42c7-93e1-2b4fac83d78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcaf9421-4012-48be-b1dd-dc3dcb05dce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcaf9421-4012-48be-b1dd-dc3dcb05dce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1541048285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c0aac4a9fd4f80b5d227729b4e10a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:12:03Z,use_quota=True,user_id='3016c4808576425eacabf0dbd9a3c37c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1746b1d1-d812-4474-89dc-e6107b2af771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1746b1d1-d812-4474-89dc-e6107b2af771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:03 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b4f39a-5479-4465-a0de-fb6a15f0b3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b4f39a-5479-4465-a0de-fb6a15f0b3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05', 'volume_name': 'volume-8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b5756a-d5bc-404b-83a6-b2663a894a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b5756a-d5bc-404b-83a6-b2663a894a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3e82d88-ca6f-41a7-94e3-5bb3bbddef71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:03 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Volume 8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05', 'volume_size': 1}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1541048285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c0aac4a9fd4f80b5d227729b4e10a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:12:03Z,use_quota=True,user_id='3016c4808576425eacabf0dbd9a3c37c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Creating volume 8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:12:03 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c8b966b7-ba99-4f3f-841b-c580001bcc0c tempest-VolumesExtendTest-1719333140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-07045dde-1a36-4fb4-b421-1e3379ed01f3" returned: 0 in 0.606s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:03 devstack sudo[97365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05 1073741824
Nov 05 15:12:03 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c8b966b7-ba99-4f3f-841b-c580001bcc0c tempest-VolumesExtendTest-1719333140 None] Lock "cinder-quobyte-07045dde-1a36-4fb4-b421-1e3379ed01f3" released by "delete_volume" :: held 1.394s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-c8b966b7-ba99-4f3f-841b-c580001bcc0c tempest-VolumesExtendTest-1719333140 None] Created reservations ['29039c29-9ce6-4971-ac2e-be1034f86d97', '0b8480ff-a51c-4d02-961f-6b463e2a10ba', 'ac699681-0348-4927-a933-28a0a9b6d5d3', 'ba972d05-92b5-4fe5-8541-3a3131719ba3'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c8b966b7-ba99-4f3f-841b-c580001bcc0c tempest-VolumesExtendTest-1719333140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c8b966b7-ba99-4f3f-841b-c580001bcc0c tempest-VolumesExtendTest-1719333140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c8b966b7-ba99-4f3f-841b-c580001bcc0c tempest-VolumesExtendTest-1719333140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c8b966b7-ba99-4f3f-841b-c580001bcc0c tempest-VolumesExtendTest-1719333140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c8b966b7-ba99-4f3f-841b-c580001bcc0c tempest-VolumesExtendTest-1719333140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c8b966b7-ba99-4f3f-841b-c580001bcc0c tempest-VolumesExtendTest-1719333140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:03 devstack sudo[97372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:12:03 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:03 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c8b966b7-ba99-4f3f-841b-c580001bcc0c tempest-VolumesExtendTest-1719333140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.316s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-c8b966b7-ba99-4f3f-841b-c580001bcc0c tempest-VolumesExtendTest-1719333140 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:12:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c8b966b7-ba99-4f3f-841b-c580001bcc0c tempest-VolumesExtendTest-1719333140 None] Deleted volume successfully.
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c8b966b7-ba99-4f3f-841b-c580001bcc0c tempest-VolumesExtendTest-1719333140 None] Lock "cinder-07045dde-1a36-4fb4-b421-1e3379ed01f3-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:12:03 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05 1073741824" returned: 0 in 0.614s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:03 devstack sudo[97396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05
Nov 05 15:12:03 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:04 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05" returned: 0 in 0.526s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:12:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3e82d88-ca6f-41a7-94e3-5bb3bbddef71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ea94cb-10b4-4c02-8a90-8c5f9f0bf261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:04 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Volume volume-8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05 (8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05): created successfully
Nov 05 15:12:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ea94cb-10b4-4c02-8a90-8c5f9f0bf261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Flow 'volume_create_manager' (44b8cb6c-d14f-42c7-93e1-2b4fac83d78c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:12:04 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6b1c9f64-cf2f-4bdc-9497-677c49135377 tempest-VolumesTransfersTest-1907760244 None] Created volume successfully.
Nov 05 15:12:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-754d5db1-7078-416c-a407-029b82d2d5a9 req-749fc760-37fa-43e9-ad77-d63bb6539c82 tempest-TestStampPattern-527871853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-754d5db1-7078-416c-a407-029b82d2d5a9 req-749fc760-37fa-43e9-ad77-d63bb6539c82 tempest-TestStampPattern-527871853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-754d5db1-7078-416c-a407-029b82d2d5a9 req-749fc760-37fa-43e9-ad77-d63bb6539c82 tempest-TestStampPattern-527871853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-754d5db1-7078-416c-a407-029b82d2d5a9 req-749fc760-37fa-43e9-ad77-d63bb6539c82 tempest-TestStampPattern-527871853 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628', 'name': 'volume-c477a72e-838b-4440-b234-e27ce72c9768', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97be5a03-090f-46db-8e85-94cedbed0146', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 15:12:05 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-754d5db1-7078-416c-a407-029b82d2d5a9 req-749fc760-37fa-43e9-ad77-d63bb6539c82 tempest-TestStampPattern-527871853 None] attachment_update completed successfully.
Nov 05 15:12:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-dc56b52d-d255-4058-8012-f2ff8ed7b688 tempest-VolumesTransfersTest-899533821 None] Transfer volume completed successfully.
Nov 05 15:12:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-23881ec3-d590-4c76-b230-b08144ec4202 tempest-VolumesTransfersTest-1699064145 None] Acquiring lock "cinder-8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:12:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-23881ec3-d590-4c76-b230-b08144ec4202 tempest-VolumesTransfersTest-1699064145 None] Lock "cinder-8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:12:07 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=101,cinder:UPDATE=115,cinder:DELETE=10,cinder:INSERT=33 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:12:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-23881ec3-d590-4c76-b230-b08144ec4202 tempest-VolumesTransfersTest-1699064145 None] Acquiring lock "cinder-quobyte-8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:12:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-23881ec3-d590-4c76-b230-b08144ec4202 tempest-VolumesTransfersTest-1699064145 None] Lock "cinder-quobyte-8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05" acquired by "delete_volume" :: waited 0.035s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:12:07 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cc4d20-b3d0-4a47-9eb4-0501fb447198]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:12:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-23881ec3-d590-4c76-b230-b08144ec4202 tempest-VolumesTransfersTest-1699064145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:08 devstack sudo[97789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05
Nov 05 15:12:08 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:08 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-23881ec3-d590-4c76-b230-b08144ec4202 tempest-VolumesTransfersTest-1699064145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05" returned: 0 in 0.525s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-23881ec3-d590-4c76-b230-b08144ec4202 tempest-VolumesTransfersTest-1699064145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:08 devstack sudo[97801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05
Nov 05 15:12:08 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:08 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-23881ec3-d590-4c76-b230-b08144ec4202 tempest-VolumesTransfersTest-1699064145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05" returned: 0 in 0.334s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-23881ec3-d590-4c76-b230-b08144ec4202 tempest-VolumesTransfersTest-1699064145 None] Lock "cinder-quobyte-8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05" released by "delete_volume" :: held 0.940s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:12:08 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=106,cinder:UPDATE=135,cinder:INSERT=33,cinder:DELETE=12 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:12:08 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-23881ec3-d590-4c76-b230-b08144ec4202 tempest-VolumesTransfersTest-1699064145 None] Created reservations ['9be2e6b2-a143-49c4-9c64-55908ff37d9b', '4aa92620-c919-4f30-aa22-f73fe908e189', '58d46ec1-d86d-49fd-970c-96a1ce7e4124', '2a50ba87-ab21-43c0-9199-a6e8eee55f32'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:12:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-23881ec3-d590-4c76-b230-b08144ec4202 tempest-VolumesTransfersTest-1699064145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-23881ec3-d590-4c76-b230-b08144ec4202 tempest-VolumesTransfersTest-1699064145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-23881ec3-d590-4c76-b230-b08144ec4202 tempest-VolumesTransfersTest-1699064145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:12:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-23881ec3-d590-4c76-b230-b08144ec4202 tempest-VolumesTransfersTest-1699064145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:12:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-23881ec3-d590-4c76-b230-b08144ec4202 tempest-VolumesTransfersTest-1699064145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-23881ec3-d590-4c76-b230-b08144ec4202 tempest-VolumesTransfersTest-1699064145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:09 devstack sudo[97805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:12:09 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:09 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-23881ec3-d590-4c76-b230-b08144ec4202 tempest-VolumesTransfersTest-1699064145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.363s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:09 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-23881ec3-d590-4c76-b230-b08144ec4202 tempest-VolumesTransfersTest-1699064145 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:12:09 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-23881ec3-d590-4c76-b230-b08144ec4202 tempest-VolumesTransfersTest-1699064145 None] Deleted volume successfully.
Nov 05 15:12:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-23881ec3-d590-4c76-b230-b08144ec4202 tempest-VolumesTransfersTest-1699064145 None] Lock "cinder-8ad3aa77-7ae7-4ab6-ae05-8e869c5f9c05-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:12:10 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:12:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Flow 'volume_create_manager' (febf2376-d8ae-4dcf-8191-7fce845a62af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:12:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (563b0bd1-9c65-4840-86b9-2074ce86864a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (563b0bd1-9c65-4840-86b9-2074ce86864a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1109693672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee5e33d1-5dca-4db4-b270-3ed537637731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c0aac4a9fd4f80b5d227729b4e10a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:12:11Z,use_quota=True,user_id='3016c4808576425eacabf0dbd9a3c37c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d5c8d5-e55c-4a17-b0c1-a3a354f8b39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d5c8d5-e55c-4a17-b0c1-a3a354f8b39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a035a4-75a9-4c27-8506-345e9ef6718f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a035a4-75a9-4c27-8506-345e9ef6718f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee5e33d1-5dca-4db4-b270-3ed537637731', 'volume_name': 'volume-ee5e33d1-5dca-4db4-b270-3ed537637731', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d131f89-3d9d-4052-b5ff-77e0c7d32da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d131f89-3d9d-4052-b5ff-77e0c7d32da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5eb5a9-302d-4ba9-8f9a-fb1858cacfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:10 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Volume ee5e33d1-5dca-4db4-b270-3ed537637731: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee5e33d1-5dca-4db4-b270-3ed537637731', 'volume_size': 1}
Nov 05 15:12:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1109693672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee5e33d1-5dca-4db4-b270-3ed537637731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c0aac4a9fd4f80b5d227729b4e10a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:12:11Z,use_quota=True,user_id='3016c4808576425eacabf0dbd9a3c37c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:12:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Creating volume ee5e33d1-5dca-4db4-b270-3ed537637731 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:12:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:12:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:12:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:12:10 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:12:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ee5e33d1-5dca-4db4-b270-3ed537637731 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:10 devstack sudo[97814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ee5e33d1-5dca-4db4-b270-3ed537637731 1073741824
Nov 05 15:12:10 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:11 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ee5e33d1-5dca-4db4-b270-3ed537637731 1073741824" returned: 0 in 0.580s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ee5e33d1-5dca-4db4-b270-3ed537637731 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:11 devstack sudo[97825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ee5e33d1-5dca-4db4-b270-3ed537637731
Nov 05 15:12:11 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:11 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ee5e33d1-5dca-4db4-b270-3ed537637731" returned: 0 in 0.371s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:12:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5eb5a9-302d-4ba9-8f9a-fb1858cacfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee5e33d1-5dca-4db4-b270-3ed537637731', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4748c454-9ac7-4491-b824-587f2a173dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:11 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Volume volume-ee5e33d1-5dca-4db4-b270-3ed537637731 (ee5e33d1-5dca-4db4-b270-3ed537637731): created successfully
Nov 05 15:12:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4748c454-9ac7-4491-b824-587f2a173dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Flow 'volume_create_manager' (febf2376-d8ae-4dcf-8191-7fce845a62af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:12:12 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c4ee99cc-0591-4dc5-9ae6-000d561be4d4 tempest-VolumesTransfersTest-1907760244 None] Created volume successfully.
Nov 05 15:12:12 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-626bd741-fefe-4edb-acfe-afd5b15f2031 req-04e9805e-ea9f-4d0f-a58b-8bd874e250cf tempest-TestStampPattern-527871853 None] Terminate volume connection completed successfully.
Nov 05 15:12:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-626bd741-fefe-4edb-acfe-afd5b15f2031 req-04e9805e-ea9f-4d0f-a58b-8bd874e250cf tempest-TestStampPattern-527871853 None] Deleting attachment 97be5a03-090f-46db-8e85-94cedbed0146. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 15:12:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-34a6ebc9-579a-46f1-b0fe-82fa312f123e tempest-VolumesTransfersTest-1699064145 None] Acquiring lock "cinder-ee5e33d1-5dca-4db4-b270-3ed537637731-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:12:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-34a6ebc9-579a-46f1-b0fe-82fa312f123e tempest-VolumesTransfersTest-1699064145 None] Lock "cinder-ee5e33d1-5dca-4db4-b270-3ed537637731-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:12:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-391e5e34-038e-4fa9-b18d-4edcdf7888bb tempest-TestStampPattern-527871853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-391e5e34-038e-4fa9-b18d-4edcdf7888bb tempest-TestStampPattern-527871853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-391e5e34-038e-4fa9-b18d-4edcdf7888bb tempest-TestStampPattern-527871853 None] Creating offline snapshot 7f0ae11e-eaaa-421f-8b4e-34f782449bea of volume c477a72e-838b-4440-b234-e27ce72c9768 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:12:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-34a6ebc9-579a-46f1-b0fe-82fa312f123e tempest-VolumesTransfersTest-1699064145 None] Acquiring lock "cinder-quobyte-ee5e33d1-5dca-4db4-b270-3ed537637731" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:12:13 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3000959f-cd6f-49b8-a905-13feed9ce014]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:12:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-391e5e34-038e-4fa9-b18d-4edcdf7888bb tempest-TestStampPattern-527871853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-34a6ebc9-579a-46f1-b0fe-82fa312f123e tempest-VolumesTransfersTest-1699064145 None] Lock "cinder-quobyte-ee5e33d1-5dca-4db4-b270-3ed537637731" acquired by "delete_volume" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:12:13 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d91c302-d32d-4c79-9b04-0f485781dbdd]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:12:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-34a6ebc9-579a-46f1-b0fe-82fa312f123e tempest-VolumesTransfersTest-1699064145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ee5e33d1-5dca-4db4-b270-3ed537637731 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:13 devstack sudo[97830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768
Nov 05 15:12:13 devstack sudo[97831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ee5e33d1-5dca-4db4-b270-3ed537637731
Nov 05 15:12:13 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:13 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:13 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:13 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-34a6ebc9-579a-46f1-b0fe-82fa312f123e tempest-VolumesTransfersTest-1699064145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ee5e33d1-5dca-4db4-b270-3ed537637731" returned: 0 in 0.495s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-34a6ebc9-579a-46f1-b0fe-82fa312f123e tempest-VolumesTransfersTest-1699064145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ee5e33d1-5dca-4db4-b270-3ed537637731 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-391e5e34-038e-4fa9-b18d-4edcdf7888bb tempest-TestStampPattern-527871853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768" returned: 0 in 0.563s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-391e5e34-038e-4fa9-b18d-4edcdf7888bb tempest-TestStampPattern-527871853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.7f0ae11e-eaaa-421f-8b4e-34f782449bea 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:14 devstack sudo[97840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ee5e33d1-5dca-4db4-b270-3ed537637731
Nov 05 15:12:14 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:14 devstack sudo[97841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.7f0ae11e-eaaa-421f-8b4e-34f782449bea 1G
Nov 05 15:12:14 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:14 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-34a6ebc9-579a-46f1-b0fe-82fa312f123e tempest-VolumesTransfersTest-1699064145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ee5e33d1-5dca-4db4-b270-3ed537637731" returned: 0 in 0.302s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-34a6ebc9-579a-46f1-b0fe-82fa312f123e tempest-VolumesTransfersTest-1699064145 None] Lock "cinder-quobyte-ee5e33d1-5dca-4db4-b270-3ed537637731" released by "delete_volume" :: held 0.859s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:12:14 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-34a6ebc9-579a-46f1-b0fe-82fa312f123e tempest-VolumesTransfersTest-1699064145 None] Created reservations ['ce4fdd76-3ddc-4937-b2b4-c6e767af5ec4', 'ffdee360-7369-4b8a-b4ad-72841cff4cf9', '3ff3abe1-b858-46d0-ac63-bb6b355b385c', '9976944a-e929-4f6c-a936-06a97e936940'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:12:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-34a6ebc9-579a-46f1-b0fe-82fa312f123e tempest-VolumesTransfersTest-1699064145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-34a6ebc9-579a-46f1-b0fe-82fa312f123e tempest-VolumesTransfersTest-1699064145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-34a6ebc9-579a-46f1-b0fe-82fa312f123e tempest-VolumesTransfersTest-1699064145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:12:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-34a6ebc9-579a-46f1-b0fe-82fa312f123e tempest-VolumesTransfersTest-1699064145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:12:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-34a6ebc9-579a-46f1-b0fe-82fa312f123e tempest-VolumesTransfersTest-1699064145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-34a6ebc9-579a-46f1-b0fe-82fa312f123e tempest-VolumesTransfersTest-1699064145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:14 devstack sudo[97848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:12:14 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:14 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-391e5e34-038e-4fa9-b18d-4edcdf7888bb tempest-TestStampPattern-527871853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.7f0ae11e-eaaa-421f-8b4e-34f782449bea 1G" returned: 0 in 0.748s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-391e5e34-038e-4fa9-b18d-4edcdf7888bb tempest-TestStampPattern-527871853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c477a72e-838b-4440-b234-e27ce72c9768 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.7f0ae11e-eaaa-421f-8b4e-34f782449bea {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:14 devstack sudo[97851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c477a72e-838b-4440-b234-e27ce72c9768 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.7f0ae11e-eaaa-421f-8b4e-34f782449bea
Nov 05 15:12:14 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:14 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-34a6ebc9-579a-46f1-b0fe-82fa312f123e tempest-VolumesTransfersTest-1699064145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.333s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:14 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-34a6ebc9-579a-46f1-b0fe-82fa312f123e tempest-VolumesTransfersTest-1699064145 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:12:14 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-34a6ebc9-579a-46f1-b0fe-82fa312f123e tempest-VolumesTransfersTest-1699064145 None] Deleted volume successfully.
Nov 05 15:12:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-34a6ebc9-579a-46f1-b0fe-82fa312f123e tempest-VolumesTransfersTest-1699064145 None] Lock "cinder-ee5e33d1-5dca-4db4-b270-3ed537637731-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:12:15 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-391e5e34-038e-4fa9-b18d-4edcdf7888bb tempest-TestStampPattern-527871853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c477a72e-838b-4440-b234-e27ce72c9768 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.7f0ae11e-eaaa-421f-8b4e-34f782449bea" returned: 0 in 0.354s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:15 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-391e5e34-038e-4fa9-b18d-4edcdf7888bb tempest-TestStampPattern-527871853 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.7f0ae11e-eaaa-421f-8b4e-34f782449bea is being set with open permissions: ugo+rw
Nov 05 15:12:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-391e5e34-038e-4fa9-b18d-4edcdf7888bb tempest-TestStampPattern-527871853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.7f0ae11e-eaaa-421f-8b4e-34f782449bea {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:15 devstack sudo[97858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.7f0ae11e-eaaa-421f-8b4e-34f782449bea
Nov 05 15:12:15 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:15 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-391e5e34-038e-4fa9-b18d-4edcdf7888bb tempest-TestStampPattern-527871853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.7f0ae11e-eaaa-421f-8b4e-34f782449bea" returned: 0 in 0.279s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-391e5e34-038e-4fa9-b18d-4edcdf7888bb tempest-TestStampPattern-527871853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:15 devstack sudo[97861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.info
Nov 05 15:12:15 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:15 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-391e5e34-038e-4fa9-b18d-4edcdf7888bb tempest-TestStampPattern-527871853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.info" returned: 0 in 0.279s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:15 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-391e5e34-038e-4fa9-b18d-4edcdf7888bb tempest-TestStampPattern-527871853 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.info is being set with open permissions: ugo+rw
Nov 05 15:12:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-391e5e34-038e-4fa9-b18d-4edcdf7888bb tempest-TestStampPattern-527871853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:15 devstack sudo[97864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.info
Nov 05 15:12:15 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:16 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-391e5e34-038e-4fa9-b18d-4edcdf7888bb tempest-TestStampPattern-527871853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.info" returned: 0 in 0.321s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-391e5e34-038e-4fa9-b18d-4edcdf7888bb tempest-TestStampPattern-527871853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.711s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:16 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-391e5e34-038e-4fa9-b18d-4edcdf7888bb tempest-TestStampPattern-527871853 None] Create snapshot completed successfully
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Flow 'volume_create_manager' (a80809c9-f949-4b0f-83b9-920792cfbe8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8d6c0f-2371-4ece-b055-b5f9328233a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8d6c0f-2371-4ece-b055-b5f9328233a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1422385160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f1227c-951f-4d55-a886-9135102a4c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fde7ba0bd2f4e7bab8ba379d6c352a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7f0ae11e-eaaa-421f-8b4e-34f782449bea,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:12:25Z,use_quota=True,user_id='9d139cb520204951934ac5148895b694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b06125-8100-42f6-8678-2bf6e0f07463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b06125-8100-42f6-8678-2bf6e0f07463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa06d37-67ed-43ef-9524-83571ea84a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa06d37-67ed-43ef-9524-83571ea84a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '33f1227c-951f-4d55-a886-9135102a4c3f', 'volume_name': 'volume-33f1227c-951f-4d55-a886-9135102a4c3f', 'volume_size': 1, 'snapshot_id': '7f0ae11e-eaaa-421f-8b4e-34f782449bea'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c79ffe-60ce-422f-adee-d2d35eff55d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c79ffe-60ce-422f-adee-d2d35eff55d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9370f6c9-b664-49ad-b7bf-43ce8a83c2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:25 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Volume 33f1227c-951f-4d55-a886-9135102a4c3f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-33f1227c-951f-4d55-a886-9135102a4c3f', 'volume_size': 1, 'snapshot_id': '7f0ae11e-eaaa-421f-8b4e-34f782449bea'}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Acquiring lock "cinder-quobyte-7f0ae11e-eaaa-421f-8b4e-34f782449bea-33f1227c-951f-4d55-a886-9135102a4c3f" by "_create_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Lock "cinder-quobyte-7f0ae11e-eaaa-421f-8b4e-34f782449bea-33f1227c-951f-4d55-a886-9135102a4c3f" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Creating volume 33f1227c-951f-4d55-a886-9135102a4c3f from snapshot 7f0ae11e-eaaa-421f-8b4e-34f782449bea {{(pid=87150) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Acquiring lock "cinder-quobyte-33f1227c-951f-4d55-a886-9135102a4c3f" by "_copy_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Lock "cinder-quobyte-33f1227c-951f-4d55-a886-9135102a4c3f" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] snapshot: 7f0ae11e-eaaa-421f-8b4e-34f782449bea, volume: 33f1227c-951f-4d55-a886-9135102a4c3f,  {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[357d23ca-f46b-481f-8ad6-ad725cd4757a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.7f0ae11e-eaaa-421f-8b4e-34f782449bea {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:25 devstack sudo[97979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.7f0ae11e-eaaa-421f-8b4e-34f782449bea
Nov 05 15:12:25 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:25 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.7f0ae11e-eaaa-421f-8b4e-34f782449bea" returned: 0 in 0.484s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c477a72e-838b-4440-b234-e27ce72c9768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[716cb5ae-bbe7-4f1e-bfa1-c42c3d6e1300]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:12:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:26 devstack sudo[97984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768
Nov 05 15:12:26 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:26 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768" returned: 0 in 0.512s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768 {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 15:12:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Creating direct copy from snapshot {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 15:12:26 devstack cinder-volume[87150]: DEBUG cinder.utils [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Path /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-33f1227c-951f-4d55-a886-9135102a4c3f not found in is_blk_device check {{(pid=87150) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 15:12:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-33f1227c-951f-4d55-a886-9135102a4c3f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:26 devstack sudo[97993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-33f1227c-951f-4d55-a886-9135102a4c3f
Nov 05 15:12:26 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:27 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:12:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Flow 'volume_create_manager' (756bd2ab-d2ef-40c0-a2ef-ded08872cfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:12:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad80bdfd-a45d-4962-b24e-2f698d5c8159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad80bdfd-a45d-4962-b24e-2f698d5c8159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-153833294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3997e7-711e-4e1f-8c1f-5e25e51fce6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827fdac216c3413fa74f5a72a55eaa06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:12:27Z,use_quota=True,user_id='8ca9c9ba0a6b4dd19c3a7ee9409b911c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f47aec-5c49-44af-ba8f-a029077dce49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f47aec-5c49-44af-ba8f-a029077dce49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71343c51-d2c3-45d8-8ac6-7041c5bb6b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71343c51-d2c3-45d8-8ac6-7041c5bb6b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e3997e7-711e-4e1f-8c1f-5e25e51fce6b', 'volume_name': 'volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2259f75-1dc2-45cd-948e-5196a3314496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2259f75-1dc2-45cd-948e-5196a3314496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f38c4d-caf3-4cc3-b1de-773d21512cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:27 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Volume 8e3997e7-711e-4e1f-8c1f-5e25e51fce6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b', 'volume_size': 1}
Nov 05 15:12:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:27 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:12:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Flow 'volume_create_manager' (df108bda-7aa4-4785-96de-c8cb8ccc5a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:12:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82607dd-57a5-4768-b2e8-c06f3da018b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82607dd-57a5-4768-b2e8-c06f3da018b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2093387574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac3dd03-24f0-4529-be87-0c54971efd2d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0d2c00ed0df04d6889a72fafaf210c83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:12:27Z,use_quota=True,user_id='05423723a9d14c8abb97f22387c6e2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f14900ca-631e-4e5d-b76b-b70f393eb0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f14900ca-631e-4e5d-b76b-b70f393eb0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd69c0da-a3c7-4c30-939e-caa0f834418c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd69c0da-a3c7-4c30-939e-caa0f834418c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ac3dd03-24f0-4529-be87-0c54971efd2d', 'volume_name': 'volume-3ac3dd03-24f0-4529-be87-0c54971efd2d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0719a6-dbd6-4c0c-9550-198bae98f833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0719a6-dbd6-4c0c-9550-198bae98f833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a97f6b-854d-4d07-ae35-24f354d8622a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:27 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Volume 3ac3dd03-24f0-4529-be87-0c54971efd2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ac3dd03-24f0-4529-be87-0c54971efd2d', 'volume_size': 1}
Nov 05 15:12:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:32 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-1d8f19b3-989b-4310-9639-cc65c7904aab req-d5ddf03a-2838-4c32-8197-3754700570b9 tempest-AttachVolumeTestJSON-2065852907 None] Terminate volume connection completed successfully.
Nov 05 15:12:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-1d8f19b3-989b-4310-9639-cc65c7904aab req-d5ddf03a-2838-4c32-8197-3754700570b9 tempest-AttachVolumeTestJSON-2065852907 None] Deleting attachment 526312fd-50c9-4ecc-b702-f9bc28d7d9cf. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 15:12:36 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-33f1227c-951f-4d55-a886-9135102a4c3f" returned: 0 in 9.730s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:36 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Image conversion details: src /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768, size 1024.00 MB, duration 9.73 sec, destination /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-33f1227c-951f-4d55-a886-9135102a4c3f {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:12:36 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Converted 1024.00 MB image at 105.23 MB/s
Nov 05 15:12:36 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-33f1227c-951f-4d55-a886-9135102a4c3f is being set with open permissions: ugo+rw
Nov 05 15:12:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-33f1227c-951f-4d55-a886-9135102a4c3f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:36 devstack sudo[98053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-33f1227c-951f-4d55-a886-9135102a4c3f
Nov 05 15:12:36 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:36 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-33f1227c-951f-4d55-a886-9135102a4c3f" returned: 0 in 0.383s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Lock "cinder-quobyte-33f1227c-951f-4d55-a886-9135102a4c3f" released by "_copy_volume_from_snapshot" :: held 11.259s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:12:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Lock "cinder-quobyte-7f0ae11e-eaaa-421f-8b4e-34f782449bea-33f1227c-951f-4d55-a886-9135102a4c3f" released by "_create_volume_from_snapshot" :: held 11.467s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:12:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.485s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.384s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-153833294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3997e7-711e-4e1f-8c1f-5e25e51fce6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827fdac216c3413fa74f5a72a55eaa06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:12:27Z,use_quota=True,user_id='8ca9c9ba0a6b4dd19c3a7ee9409b911c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:12:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Creating volume 8e3997e7-711e-4e1f-8c1f-5e25e51fce6b {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:12:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:12:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:12:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:12:36 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:12:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:36 devstack sudo[98073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b 1073741824
Nov 05 15:12:36 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9370f6c9-b664-49ad-b7bf-43ce8a83c2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33f1227c-951f-4d55-a886-9135102a4c3f', 'volume_size': 1, 'snapshot_id': '7f0ae11e-eaaa-421f-8b4e-34f782449bea'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7adb58d8-16de-4bf4-9bb3-1b53e8a0e07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:36 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Volume volume-33f1227c-951f-4d55-a886-9135102a4c3f (33f1227c-951f-4d55-a886-9135102a4c3f): created successfully
Nov 05 15:12:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7adb58d8-16de-4bf4-9bb3-1b53e8a0e07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Flow 'volume_create_manager' (a80809c9-f949-4b0f-83b9-920792cfbe8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:12:37 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f5eb2141-65e9-4e28-9fa1-ec88091bcd47 tempest-TestStampPattern-527871853 None] Created volume successfully.
Nov 05 15:12:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:12:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:12:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:12:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:37 devstack sudo[98106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:12:37 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:37 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b 1073741824" returned: 0 in 0.798s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:37 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.343s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:12:37 devstack sudo[98111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b
Nov 05 15:12:37 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:12:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 15:12:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread info: [<_MainThread(MainThread, started 136317437956224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136317326340928)>, <Thread(Thread-3 (stat_writer), started daemon 136317326487936)>, <Thread(Rabbit-heartbeat, started daemon 136317321464000)>, <Thread(Thread-5 (_runner), started daemon 136317321550592)>, <Thread(Thread-7 (_runner), started daemon 136317321658496)>, <Thread(fd_logger, started daemon 136317319612992)>, <Thread(privsep_reader, started daemon 136317319622400)>, <Thread(tpool_thread_0, started daemon 136317310928576)>, <Thread(tpool_thread_1, started daemon 136317302535872)>, <Thread(tpool_thread_2, started daemon 136317294143168)>, <Thread(tpool_thread_3, started daemon 136317285750464)>, <Thread(tpool_thread_4, started daemon 136317277357760)>, <Thread(tpool_thread_5, started daemon 136317268965056)>, <Thread(tpool_thread_6, started daemon 136317260572352)>, <Thread(tpool_thread_7, started daemon 136317252179648)>, <Thread(tpool_thread_8, started daemon 136317243786944)>, <Thread(tpool_thread_9, started daemon 136317235394240)>, <Thread(tpool_thread_10, started daemon 136317227001536)>, <Thread(tpool_thread_11, started daemon 136317218608832)>, <Thread(tpool_thread_12, started daemon 136317210216128)>, <Thread(tpool_thread_13, started daemon 136317201807040)>, <Thread(tpool_thread_14, started daemon 136317193397952)>, <Thread(tpool_thread_15, started daemon 136317184988864)>, <Thread(tpool_thread_16, started daemon 136317176579776)>, <Thread(tpool_thread_17, started daemon 136317168170688)>, <Thread(tpool_thread_18, started daemon 136317159761600)>, <Thread(tpool_thread_19, started daemon 136317151352512)>] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 15:12:38 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b" returned: 0 in 0.630s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:12:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.599s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2093387574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac3dd03-24f0-4529-be87-0c54971efd2d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0d2c00ed0df04d6889a72fafaf210c83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:12:27Z,use_quota=True,user_id='05423723a9d14c8abb97f22387c6e2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:12:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Creating volume 3ac3dd03-24f0-4529-be87-0c54971efd2d {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:12:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:12:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:12:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:12:38 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:12:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3ac3dd03-24f0-4529-be87-0c54971efd2d 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f38c4d-caf3-4cc3-b1de-773d21512cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d98776-870a-47b4-bace-68e93b968318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:38 devstack sudo[98129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3ac3dd03-24f0-4529-be87-0c54971efd2d 1073741824
Nov 05 15:12:38 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:38 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Volume volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b (8e3997e7-711e-4e1f-8c1f-5e25e51fce6b): created successfully
Nov 05 15:12:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d98776-870a-47b4-bace-68e93b968318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Flow 'volume_create_manager' (756bd2ab-d2ef-40c0-a2ef-ded08872cfd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:12:38 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-851f3d26-5e17-4a02-9d4f-baeecc2b74a0 tempest-VolumesSnapshotTestJSON-1973636354 None] Created volume successfully.
Nov 05 15:12:39 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3ac3dd03-24f0-4529-be87-0c54971efd2d 1073741824" returned: 0 in 0.930s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3ac3dd03-24f0-4529-be87-0c54971efd2d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:39 devstack sudo[98157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3ac3dd03-24f0-4529-be87-0c54971efd2d
Nov 05 15:12:39 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:40 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3ac3dd03-24f0-4529-be87-0c54971efd2d" returned: 0 in 0.940s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:12:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a97f6b-854d-4d07-ae35-24f354d8622a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac3dd03-24f0-4529-be87-0c54971efd2d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee56b193-16e5-41d7-be62-4cf6bb79c9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:40 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Volume volume-3ac3dd03-24f0-4529-be87-0c54971efd2d (3ac3dd03-24f0-4529-be87-0c54971efd2d): created successfully
Nov 05 15:12:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee56b193-16e5-41d7-be62-4cf6bb79c9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Flow 'volume_create_manager' (df108bda-7aa4-4785-96de-c8cb8ccc5a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:12:40 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e957b026-7ed2-462f-b53d-18ae31289777 tempest-VolumesGetTest-1228684426 None] Created volume successfully.
Nov 05 15:12:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-600f5526-18db-4415-9eb1-f86f690a365a tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-600f5526-18db-4415-9eb1-f86f690a365a tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-600f5526-18db-4415-9eb1-f86f690a365a tempest-VolumesSnapshotTestJSON-1973636354 None] Creating offline snapshot ddb3063f-f277-4580-bbb6-e5c97624ac31 of volume 8e3997e7-711e-4e1f-8c1f-5e25e51fce6b {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:12:40 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fc6867-4639-46c3-a7e7-49c27a5f1b33]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:12:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-600f5526-18db-4415-9eb1-f86f690a365a tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:41 devstack sudo[98214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b
Nov 05 15:12:41 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:41 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-600f5526-18db-4415-9eb1-f86f690a365a tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b" returned: 0 in 0.965s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-600f5526-18db-4415-9eb1-f86f690a365a tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.ddb3063f-f277-4580-bbb6-e5c97624ac31 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:41 devstack sudo[98232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.ddb3063f-f277-4580-bbb6-e5c97624ac31 1G
Nov 05 15:12:41 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:42 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-600f5526-18db-4415-9eb1-f86f690a365a tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.ddb3063f-f277-4580-bbb6-e5c97624ac31 1G" returned: 0 in 0.863s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-600f5526-18db-4415-9eb1-f86f690a365a tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.ddb3063f-f277-4580-bbb6-e5c97624ac31 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:42 devstack sudo[98239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.ddb3063f-f277-4580-bbb6-e5c97624ac31
Nov 05 15:12:42 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:43 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-600f5526-18db-4415-9eb1-f86f690a365a tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.ddb3063f-f277-4580-bbb6-e5c97624ac31" returned: 0 in 0.589s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:43 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-600f5526-18db-4415-9eb1-f86f690a365a tempest-VolumesSnapshotTestJSON-1973636354 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.ddb3063f-f277-4580-bbb6-e5c97624ac31 is being set with open permissions: ugo+rw
Nov 05 15:12:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-600f5526-18db-4415-9eb1-f86f690a365a tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.ddb3063f-f277-4580-bbb6-e5c97624ac31 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:43 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:12:43 devstack sudo[98244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.ddb3063f-f277-4580-bbb6-e5c97624ac31
Nov 05 15:12:43 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Flow 'volume_create_manager' (1ec2d58a-e8fa-48fe-b94e-9746ed1b3780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:12:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9c476a-cc40-462a-ad23-64ba38148eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9c476a-cc40-462a-ad23-64ba38148eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:12:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1558592562',display_name='tempest-VolumesGetTest-Volume-229890876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8b97a5-27b9-41e6-ab54-e78b49a5b88d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2c00ed0df04d6889a72fafaf210c83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:12:43Z,use_quota=True,user_id='05423723a9d14c8abb97f22387c6e2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e5ee29-9e92-413a-b7ea-1aa08cb88737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e5ee29-9e92-413a-b7ea-1aa08cb88737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7db231-b4a6-49f7-8409-42e7013d7bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7db231-b4a6-49f7-8409-42e7013d7bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b8b97a5-27b9-41e6-ab54-e78b49a5b88d', 'volume_name': 'volume-1b8b97a5-27b9-41e6-ab54-e78b49a5b88d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b054b3-a06f-48cf-aafb-508e73fef044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b054b3-a06f-48cf-aafb-508e73fef044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c102abda-d861-448e-9874-b2a4e1eec89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:43 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Volume 1b8b97a5-27b9-41e6-ab54-e78b49a5b88d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b8b97a5-27b9-41e6-ab54-e78b49a5b88d', 'volume_size': 1}
Nov 05 15:12:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:43 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-600f5526-18db-4415-9eb1-f86f690a365a tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.ddb3063f-f277-4580-bbb6-e5c97624ac31" returned: 0 in 0.517s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-600f5526-18db-4415-9eb1-f86f690a365a tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:43 devstack sudo[98247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.info
Nov 05 15:12:43 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:44 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-600f5526-18db-4415-9eb1-f86f690a365a tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.info" returned: 0 in 0.402s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:44 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-600f5526-18db-4415-9eb1-f86f690a365a tempest-VolumesSnapshotTestJSON-1973636354 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.info is being set with open permissions: ugo+rw
Nov 05 15:12:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-600f5526-18db-4415-9eb1-f86f690a365a tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:44 devstack sudo[98250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.info
Nov 05 15:12:44 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:44 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-600f5526-18db-4415-9eb1-f86f690a365a tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.info" returned: 0 in 0.336s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-600f5526-18db-4415-9eb1-f86f690a365a tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.867s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.207s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:12:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1558592562',display_name='tempest-VolumesGetTest-Volume-229890876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8b97a5-27b9-41e6-ab54-e78b49a5b88d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2c00ed0df04d6889a72fafaf210c83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:12:43Z,use_quota=True,user_id='05423723a9d14c8abb97f22387c6e2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:12:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Creating volume 1b8b97a5-27b9-41e6-ab54-e78b49a5b88d {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:12:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:12:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:12:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:12:44 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:12:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1b8b97a5-27b9-41e6-ab54-e78b49a5b88d 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:44 devstack sudo[98253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1b8b97a5-27b9-41e6-ab54-e78b49a5b88d 1073741824
Nov 05 15:12:44 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:44 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-600f5526-18db-4415-9eb1-f86f690a365a tempest-VolumesSnapshotTestJSON-1973636354 None] Create snapshot completed successfully
Nov 05 15:12:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0b62821c-eeae-48aa-9556-a48d2467af5c tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "cinder-ddb3063f-f277-4580-bbb6-e5c97624ac31-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:12:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0b62821c-eeae-48aa-9556-a48d2467af5c tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-ddb3063f-f277-4580-bbb6-e5c97624ac31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:12:45 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1b8b97a5-27b9-41e6-ab54-e78b49a5b88d 1073741824" returned: 0 in 0.830s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1b8b97a5-27b9-41e6-ab54-e78b49a5b88d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0b62821c-eeae-48aa-9556-a48d2467af5c tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "cinder-quobyte-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:12:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0b62821c-eeae-48aa-9556-a48d2467af5c tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:12:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0b62821c-eeae-48aa-9556-a48d2467af5c tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "cinder-quobyte-ddb3063f-f277-4580-bbb6-e5c97624ac31" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:12:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0b62821c-eeae-48aa-9556-a48d2467af5c tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-ddb3063f-f277-4580-bbb6-e5c97624ac31" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:12:45 devstack sudo[98259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1b8b97a5-27b9-41e6-ab54-e78b49a5b88d
Nov 05 15:12:45 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-0b62821c-eeae-48aa-9556-a48d2467af5c tempest-VolumesSnapshotTestJSON-1973636354 None] Deleting offline snapshot ddb3063f-f277-4580-bbb6-e5c97624ac31 of volume 8e3997e7-711e-4e1f-8c1f-5e25e51fce6b {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:12:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-0b62821c-eeae-48aa-9556-a48d2467af5c tempest-VolumesSnapshotTestJSON-1973636354 None] snapshot_file for this snap is: volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.ddb3063f-f277-4580-bbb6-e5c97624ac31 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:12:45 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0efbc2-52c9-4520-b5ba-3511785fe655]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:12:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b62821c-eeae-48aa-9556-a48d2467af5c tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.ddb3063f-f277-4580-bbb6-e5c97624ac31 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:45 devstack sudo[98261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.ddb3063f-f277-4580-bbb6-e5c97624ac31
Nov 05 15:12:45 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:45 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1b8b97a5-27b9-41e6-ab54-e78b49a5b88d" returned: 0 in 0.463s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:12:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c102abda-d861-448e-9874-b2a4e1eec89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b8b97a5-27b9-41e6-ab54-e78b49a5b88d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b9058f-d300-419b-96c2-a380e41ea915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:45 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Volume volume-1b8b97a5-27b9-41e6-ab54-e78b49a5b88d (1b8b97a5-27b9-41e6-ab54-e78b49a5b88d): created successfully
Nov 05 15:12:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b9058f-d300-419b-96c2-a380e41ea915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Flow 'volume_create_manager' (1ec2d58a-e8fa-48fe-b94e-9746ed1b3780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:12:46 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4e3e1967-baae-4960-ae96-af6d30715060 tempest-VolumesGetTest-1228684426 None] Created volume successfully.
Nov 05 15:12:46 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b62821c-eeae-48aa-9556-a48d2467af5c tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.ddb3063f-f277-4580-bbb6-e5c97624ac31" returned: 0 in 0.607s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-0b62821c-eeae-48aa-9556-a48d2467af5c tempest-VolumesSnapshotTestJSON-1973636354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:12:46 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[14462180-f46a-40c8-9a3e-74528d7bb7f1]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:12:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b62821c-eeae-48aa-9556-a48d2467af5c tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:46 devstack sudo[98270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b
Nov 05 15:12:46 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-36dbb4ec-3917-4cc8-89ce-806bc0956900 tempest-VolumesGetTest-1228684426 None] Acquiring lock "cinder-1b8b97a5-27b9-41e6-ab54-e78b49a5b88d-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:12:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-36dbb4ec-3917-4cc8-89ce-806bc0956900 tempest-VolumesGetTest-1228684426 None] Lock "cinder-1b8b97a5-27b9-41e6-ab54-e78b49a5b88d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:12:46 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b62821c-eeae-48aa-9556-a48d2467af5c tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b" returned: 0 in 0.559s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b62821c-eeae-48aa-9556-a48d2467af5c tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.ddb3063f-f277-4580-bbb6-e5c97624ac31 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:46 devstack sudo[98276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.ddb3063f-f277-4580-bbb6-e5c97624ac31
Nov 05 15:12:46 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-36dbb4ec-3917-4cc8-89ce-806bc0956900 tempest-VolumesGetTest-1228684426 None] Acquiring lock "cinder-quobyte-1b8b97a5-27b9-41e6-ab54-e78b49a5b88d" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:12:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-36dbb4ec-3917-4cc8-89ce-806bc0956900 tempest-VolumesGetTest-1228684426 None] Lock "cinder-quobyte-1b8b97a5-27b9-41e6-ab54-e78b49a5b88d" acquired by "delete_volume" :: waited 0.036s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:12:46 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e4d80e-45a0-4246-943f-42a36259da7f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:12:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36dbb4ec-3917-4cc8-89ce-806bc0956900 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1b8b97a5-27b9-41e6-ab54-e78b49a5b88d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:47 devstack sudo[98278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1b8b97a5-27b9-41e6-ab54-e78b49a5b88d
Nov 05 15:12:47 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:47 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b62821c-eeae-48aa-9556-a48d2467af5c tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.ddb3063f-f277-4580-bbb6-e5c97624ac31" returned: 0 in 0.741s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b62821c-eeae-48aa-9556-a48d2467af5c tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.ddb3063f-f277-4580-bbb6-e5c97624ac31 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:47 devstack sudo[98283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.ddb3063f-f277-4580-bbb6-e5c97624ac31
Nov 05 15:12:47 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:47 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36dbb4ec-3917-4cc8-89ce-806bc0956900 tempest-VolumesGetTest-1228684426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1b8b97a5-27b9-41e6-ab54-e78b49a5b88d" returned: 0 in 0.858s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36dbb4ec-3917-4cc8-89ce-806bc0956900 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1b8b97a5-27b9-41e6-ab54-e78b49a5b88d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:47 devstack sudo[98288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1b8b97a5-27b9-41e6-ab54-e78b49a5b88d
Nov 05 15:12:47 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:47 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b62821c-eeae-48aa-9556-a48d2467af5c tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b.ddb3063f-f277-4580-bbb6-e5c97624ac31" returned: 0 in 0.496s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0b62821c-eeae-48aa-9556-a48d2467af5c tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-ddb3063f-f277-4580-bbb6-e5c97624ac31" released by "_delete_snapshot" :: held 2.594s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:12:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0b62821c-eeae-48aa-9556-a48d2467af5c tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b" released by "delete_snapshot" :: held 2.629s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:12:48 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36dbb4ec-3917-4cc8-89ce-806bc0956900 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1b8b97a5-27b9-41e6-ab54-e78b49a5b88d" returned: 0 in 0.342s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-36dbb4ec-3917-4cc8-89ce-806bc0956900 tempest-VolumesGetTest-1228684426 None] Lock "cinder-quobyte-1b8b97a5-27b9-41e6-ab54-e78b49a5b88d" released by "delete_volume" :: held 1.306s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:12:48 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-0b62821c-eeae-48aa-9556-a48d2467af5c tempest-VolumesSnapshotTestJSON-1973636354 None] Created reservations ['06f72f19-bdb4-448a-8faf-e79de19fb56e', '1a7c0f64-cbee-44d5-8d5b-4055d3c1e8c0', '63315b57-6bec-4fa1-b810-949c49a5a525', 'fb02ed9b-e63e-41a7-9ab1-88214d940b62'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:12:48 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-36dbb4ec-3917-4cc8-89ce-806bc0956900 tempest-VolumesGetTest-1228684426 None] Created reservations ['48917d4a-b085-446d-b83b-32272d538c7f', '9bdd3216-f66a-45c6-8522-15eab112ef21', '43f1984e-9177-4e13-963d-9ad2e2a88b8a', '8d7f23a1-c6a0-4a55-b521-afaeda9885a8'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:12:48 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0b62821c-eeae-48aa-9556-a48d2467af5c tempest-VolumesSnapshotTestJSON-1973636354 None] Delete snapshot completed successfully.
Nov 05 15:12:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0b62821c-eeae-48aa-9556-a48d2467af5c tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-ddb3063f-f277-4580-bbb6-e5c97624ac31-delete_snapshot" released by "delete_snapshot" :: held 3.030s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:12:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-36dbb4ec-3917-4cc8-89ce-806bc0956900 tempest-VolumesGetTest-1228684426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-36dbb4ec-3917-4cc8-89ce-806bc0956900 tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-36dbb4ec-3917-4cc8-89ce-806bc0956900 tempest-VolumesGetTest-1228684426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:12:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-36dbb4ec-3917-4cc8-89ce-806bc0956900 tempest-VolumesGetTest-1228684426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:12:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-36dbb4ec-3917-4cc8-89ce-806bc0956900 tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36dbb4ec-3917-4cc8-89ce-806bc0956900 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:48 devstack sudo[98293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:12:48 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:48 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36dbb4ec-3917-4cc8-89ce-806bc0956900 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.351s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:48 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-36dbb4ec-3917-4cc8-89ce-806bc0956900 tempest-VolumesGetTest-1228684426 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:12:48 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-36dbb4ec-3917-4cc8-89ce-806bc0956900 tempest-VolumesGetTest-1228684426 None] Deleted volume successfully.
Nov 05 15:12:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-36dbb4ec-3917-4cc8-89ce-806bc0956900 tempest-VolumesGetTest-1228684426 None] Lock "cinder-1b8b97a5-27b9-41e6-ab54-e78b49a5b88d-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a723f354-6ed3-4c49-afa0-1b098c0bd753 tempest-VolumesGetTest-1228684426 None] Acquiring lock "cinder-3ac3dd03-24f0-4529-be87-0c54971efd2d-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a723f354-6ed3-4c49-afa0-1b098c0bd753 tempest-VolumesGetTest-1228684426 None] Lock "cinder-3ac3dd03-24f0-4529-be87-0c54971efd2d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a723f354-6ed3-4c49-afa0-1b098c0bd753 tempest-VolumesGetTest-1228684426 None] Acquiring lock "cinder-quobyte-3ac3dd03-24f0-4529-be87-0c54971efd2d" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a723f354-6ed3-4c49-afa0-1b098c0bd753 tempest-VolumesGetTest-1228684426 None] Lock "cinder-quobyte-3ac3dd03-24f0-4529-be87-0c54971efd2d" acquired by "delete_volume" :: waited 0.033s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[658505c6-f5a6-4b52-a2eb-ba2456492043]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a723f354-6ed3-4c49-afa0-1b098c0bd753 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3ac3dd03-24f0-4529-be87-0c54971efd2d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Flow 'volume_create_manager' (d12c0db3-7ef7-4619-840a-23788f8c4e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d992aa6-b1b7-4cac-8aaf-7ef7b2202692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d992aa6-b1b7-4cac-8aaf-7ef7b2202692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-839519321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00775a11-a00d-402d-97bd-4a545087cdc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827fdac216c3413fa74f5a72a55eaa06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:12:49Z,use_quota=True,user_id='8ca9c9ba0a6b4dd19c3a7ee9409b911c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f848c9-5b3b-4083-880b-ab7575e823d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f848c9-5b3b-4083-880b-ab7575e823d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0994ab0a-78b3-43e6-a3ac-75f5aadbc97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0994ab0a-78b3-43e6-a3ac-75f5aadbc97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00775a11-a00d-402d-97bd-4a545087cdc1', 'volume_name': 'volume-00775a11-a00d-402d-97bd-4a545087cdc1', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3670be69-f2aa-43a8-a81d-9c6c21a38449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3670be69-f2aa-43a8-a81d-9c6c21a38449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a227168c-e1ed-439f-a375-ac4684ab1315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:49 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Volume 00775a11-a00d-402d-97bd-4a545087cdc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00775a11-a00d-402d-97bd-4a545087cdc1', 'volume_size': 1}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-839519321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00775a11-a00d-402d-97bd-4a545087cdc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827fdac216c3413fa74f5a72a55eaa06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:12:49Z,use_quota=True,user_id='8ca9c9ba0a6b4dd19c3a7ee9409b911c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Creating volume 00775a11-a00d-402d-97bd-4a545087cdc1 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:12:49 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:49 devstack sudo[98297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3ac3dd03-24f0-4529-be87-0c54971efd2d
Nov 05 15:12:49 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:49 devstack sudo[98298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1 1073741824
Nov 05 15:12:49 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:49 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a723f354-6ed3-4c49-afa0-1b098c0bd753 tempest-VolumesGetTest-1228684426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3ac3dd03-24f0-4529-be87-0c54971efd2d" returned: 0 in 0.563s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a723f354-6ed3-4c49-afa0-1b098c0bd753 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3ac3dd03-24f0-4529-be87-0c54971efd2d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:49 devstack sudo[98308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3ac3dd03-24f0-4529-be87-0c54971efd2d
Nov 05 15:12:49 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:49 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1 1073741824" returned: 0 in 0.514s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:50 devstack sudo[98310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1
Nov 05 15:12:50 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:50 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a723f354-6ed3-4c49-afa0-1b098c0bd753 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3ac3dd03-24f0-4529-be87-0c54971efd2d" returned: 0 in 0.386s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a723f354-6ed3-4c49-afa0-1b098c0bd753 tempest-VolumesGetTest-1228684426 None] Lock "cinder-quobyte-3ac3dd03-24f0-4529-be87-0c54971efd2d" released by "delete_volume" :: held 1.029s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:12:50 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-a723f354-6ed3-4c49-afa0-1b098c0bd753 tempest-VolumesGetTest-1228684426 None] Created reservations ['6d31182d-be90-40af-a4b5-a59370529b41', '36a936b3-cf63-4630-8830-6e053905001c', '190ac87e-7683-46f0-a3aa-4f17b6cf3d96', 'bac35bdc-ace1-4262-8d86-6bddb2f392cc'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:12:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a723f354-6ed3-4c49-afa0-1b098c0bd753 tempest-VolumesGetTest-1228684426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a723f354-6ed3-4c49-afa0-1b098c0bd753 tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a723f354-6ed3-4c49-afa0-1b098c0bd753 tempest-VolumesGetTest-1228684426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:12:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a723f354-6ed3-4c49-afa0-1b098c0bd753 tempest-VolumesGetTest-1228684426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:12:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a723f354-6ed3-4c49-afa0-1b098c0bd753 tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a723f354-6ed3-4c49-afa0-1b098c0bd753 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:50 devstack sudo[98313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:12:50 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:50 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1" returned: 0 in 0.442s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:12:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a227168c-e1ed-439f-a375-ac4684ab1315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00775a11-a00d-402d-97bd-4a545087cdc1', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba501039-fe1a-4418-94d6-65a959acf30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:50 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Volume volume-00775a11-a00d-402d-97bd-4a545087cdc1 (00775a11-a00d-402d-97bd-4a545087cdc1): created successfully
Nov 05 15:12:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba501039-fe1a-4418-94d6-65a959acf30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Flow 'volume_create_manager' (d12c0db3-7ef7-4619-840a-23788f8c4e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:12:50 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9d39f821-503f-4f55-b8ce-3cc61591dbec tempest-VolumesSnapshotTestJSON-1973636354 None] Created volume successfully.
Nov 05 15:12:50 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a723f354-6ed3-4c49-afa0-1b098c0bd753 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.283s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:50 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a723f354-6ed3-4c49-afa0-1b098c0bd753 tempest-VolumesGetTest-1228684426 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:12:50 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a723f354-6ed3-4c49-afa0-1b098c0bd753 tempest-VolumesGetTest-1228684426 None] Deleted volume successfully.
Nov 05 15:12:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a723f354-6ed3-4c49-afa0-1b098c0bd753 tempest-VolumesGetTest-1228684426 None] Lock "cinder-3ac3dd03-24f0-4529-be87-0c54971efd2d-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:12:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-58048db7-3f81-4d35-b41f-aced9d453c2c tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-58048db7-3f81-4d35-b41f-aced9d453c2c tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-58048db7-3f81-4d35-b41f-aced9d453c2c tempest-VolumesSnapshotTestJSON-1973636354 None] Creating offline snapshot 5bad4b08-e5f1-422d-9746-d57eb10c591d of volume 00775a11-a00d-402d-97bd-4a545087cdc1 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:12:51 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d59891-371a-4abe-af09-84071a5cb41a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:12:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58048db7-3f81-4d35-b41f-aced9d453c2c tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:52 devstack sudo[98317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1
Nov 05 15:12:52 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:52 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:12:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Flow 'volume_create_manager' (aeee3f89-4248-45ea-8929-de51198b3779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:12:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba0e682-65b1-425b-9027-60cc77d06010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba0e682-65b1-425b-9027-60cc77d06010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1195319080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc6db94-7916-4baf-b58f-ae8c4f46c774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2c00ed0df04d6889a72fafaf210c83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:12:52Z,use_quota=True,user_id='05423723a9d14c8abb97f22387c6e2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931b7759-465a-40d8-9ba8-e7f510cce24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931b7759-465a-40d8-9ba8-e7f510cce24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:52 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99250b18-b858-434f-841f-6adb31ba85de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99250b18-b858-434f-841f-6adb31ba85de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fc6db94-7916-4baf-b58f-ae8c4f46c774', 'volume_name': 'volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd393ce-61ce-4398-9383-b7975f273009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd393ce-61ce-4398-9383-b7975f273009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62197fe-ccf3-4461-9eee-b5380ecb9708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:52 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Volume 1fc6db94-7916-4baf-b58f-ae8c4f46c774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774', 'volume_size': 1}
Nov 05 15:12:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58048db7-3f81-4d35-b41f-aced9d453c2c tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1" returned: 0 in 0.503s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58048db7-3f81-4d35-b41f-aced9d453c2c tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.5bad4b08-e5f1-422d-9746-d57eb10c591d 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:52 devstack sudo[98323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.5bad4b08-e5f1-422d-9746-d57eb10c591d 1G
Nov 05 15:12:52 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:52 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58048db7-3f81-4d35-b41f-aced9d453c2c tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.5bad4b08-e5f1-422d-9746-d57eb10c591d 1G" returned: 0 in 0.390s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58048db7-3f81-4d35-b41f-aced9d453c2c tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00775a11-a00d-402d-97bd-4a545087cdc1 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.5bad4b08-e5f1-422d-9746-d57eb10c591d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:52 devstack sudo[98329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00775a11-a00d-402d-97bd-4a545087cdc1 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.5bad4b08-e5f1-422d-9746-d57eb10c591d
Nov 05 15:12:52 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:53 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58048db7-3f81-4d35-b41f-aced9d453c2c tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00775a11-a00d-402d-97bd-4a545087cdc1 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.5bad4b08-e5f1-422d-9746-d57eb10c591d" returned: 0 in 0.309s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:53 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-58048db7-3f81-4d35-b41f-aced9d453c2c tempest-VolumesSnapshotTestJSON-1973636354 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.5bad4b08-e5f1-422d-9746-d57eb10c591d is being set with open permissions: ugo+rw
Nov 05 15:12:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58048db7-3f81-4d35-b41f-aced9d453c2c tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.5bad4b08-e5f1-422d-9746-d57eb10c591d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:53 devstack sudo[98344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.5bad4b08-e5f1-422d-9746-d57eb10c591d
Nov 05 15:12:53 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:53 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58048db7-3f81-4d35-b41f-aced9d453c2c tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.5bad4b08-e5f1-422d-9746-d57eb10c591d" returned: 0 in 0.255s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58048db7-3f81-4d35-b41f-aced9d453c2c tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:53 devstack sudo[98347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.info
Nov 05 15:12:53 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:53 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58048db7-3f81-4d35-b41f-aced9d453c2c tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.info" returned: 0 in 0.277s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:53 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-58048db7-3f81-4d35-b41f-aced9d453c2c tempest-VolumesSnapshotTestJSON-1973636354 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.info is being set with open permissions: ugo+rw
Nov 05 15:12:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58048db7-3f81-4d35-b41f-aced9d453c2c tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:53 devstack sudo[98350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.info
Nov 05 15:12:53 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:53 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58048db7-3f81-4d35-b41f-aced9d453c2c tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.info" returned: 0 in 0.262s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-58048db7-3f81-4d35-b41f-aced9d453c2c tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.134s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.564s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1195319080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc6db94-7916-4baf-b58f-ae8c4f46c774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2c00ed0df04d6889a72fafaf210c83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:12:52Z,use_quota=True,user_id='05423723a9d14c8abb97f22387c6e2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:12:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Creating volume 1fc6db94-7916-4baf-b58f-ae8c4f46c774 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:12:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:12:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:12:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:12:53 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:12:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:53 devstack sudo[98353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774 1073741824
Nov 05 15:12:53 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:53 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-58048db7-3f81-4d35-b41f-aced9d453c2c tempest-VolumesSnapshotTestJSON-1973636354 None] Create snapshot completed successfully
Nov 05 15:12:54 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774 1073741824" returned: 0 in 0.442s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:54 devstack sudo[98359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774
Nov 05 15:12:54 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:54 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774" returned: 0 in 0.269s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:12:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62197fe-ccf3-4461-9eee-b5380ecb9708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (399a81cc-80a1-493f-8b7d-5dad2702cbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:54 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Volume volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774 (1fc6db94-7916-4baf-b58f-ae8c4f46c774): created successfully
Nov 05 15:12:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (399a81cc-80a1-493f-8b7d-5dad2702cbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Flow 'volume_create_manager' (aeee3f89-4248-45ea-8929-de51198b3779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:12:54 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-30382ebf-44be-4e57-839c-859af75252ad tempest-VolumesGetTest-1228684426 None] Created volume successfully.
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Flow 'volume_create_manager' (0cff8193-8f45-4f33-a09a-db55097465aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f5b146-0167-4bec-9dd9-e8d169720d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f5b146-0167-4bec-9dd9-e8d169720d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-22454051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1139edef-02ef-410b-b5f4-528311caf4f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827fdac216c3413fa74f5a72a55eaa06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:12:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=5bad4b08-e5f1-422d-9746-d57eb10c591d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:12:55Z,use_quota=True,user_id='8ca9c9ba0a6b4dd19c3a7ee9409b911c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f96bcf5a-a729-4727-a3b4-a04aa1e78c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f96bcf5a-a729-4727-a3b4-a04aa1e78c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44fab0a4-086f-4da0-b1b7-1bb1c572d3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44fab0a4-086f-4da0-b1b7-1bb1c572d3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1139edef-02ef-410b-b5f4-528311caf4f1', 'volume_name': 'volume-1139edef-02ef-410b-b5f4-528311caf4f1', 'volume_size': 2, 'snapshot_id': '5bad4b08-e5f1-422d-9746-d57eb10c591d'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30361127-36bd-42ee-b187-c00df69493a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30361127-36bd-42ee-b187-c00df69493a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d0b66b-ce52-4744-a6cb-e697e8d87840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:55 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Volume 1139edef-02ef-410b-b5f4-528311caf4f1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1139edef-02ef-410b-b5f4-528311caf4f1', 'volume_size': 2, 'snapshot_id': '5bad4b08-e5f1-422d-9746-d57eb10c591d'}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "cinder-quobyte-5bad4b08-e5f1-422d-9746-d57eb10c591d-1139edef-02ef-410b-b5f4-528311caf4f1" by "_create_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-5bad4b08-e5f1-422d-9746-d57eb10c591d-1139edef-02ef-410b-b5f4-528311caf4f1" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Creating volume 1139edef-02ef-410b-b5f4-528311caf4f1 from snapshot 5bad4b08-e5f1-422d-9746-d57eb10c591d {{(pid=87150) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "cinder-quobyte-1139edef-02ef-410b-b5f4-528311caf4f1" by "_copy_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-1139edef-02ef-410b-b5f4-528311caf4f1" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] snapshot: 5bad4b08-e5f1-422d-9746-d57eb10c591d, volume: 1139edef-02ef-410b-b5f4-528311caf4f1,  {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a4fbb4-e6f5-4f6b-9088-aa14123dc0b4]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:12:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.5bad4b08-e5f1-422d-9746-d57eb10c591d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:55 devstack sudo[98362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.5bad4b08-e5f1-422d-9746-d57eb10c591d
Nov 05 15:12:55 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:56 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:12:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Flow 'volume_create_manager' (befe74b7-860e-488c-a356-bf853b65c61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:12:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99dd2248-02a0-40d9-a40e-bb022f8fd2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:56 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.5bad4b08-e5f1-422d-9746-d57eb10c591d" returned: 0 in 0.434s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00775a11-a00d-402d-97bd-4a545087cdc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:12:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99dd2248-02a0-40d9-a40e-bb022f8fd2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1642339863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98f54cb4-bf3b-42b0-9e93-c95f5d765f2f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0d2c00ed0df04d6889a72fafaf210c83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=1fc6db94-7916-4baf-b58f-ae8c4f46c774,status='creating',terminated_at=None,updated_at=2026-11-05T14:12:56Z,use_quota=True,user_id='05423723a9d14c8abb97f22387c6e2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ffcc69f-7a6d-4fa2-b4cb-b20982c95c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ffcc69f-7a6d-4fa2-b4cb-b20982c95c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfabb0a6-7b1a-47fc-897a-c861c1b2231a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:56 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceac3f2b-7af8-447c-9e1e-169d6ea4f4f3]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:12:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfabb0a6-7b1a-47fc-897a-c861c1b2231a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '98f54cb4-bf3b-42b0-9e93-c95f5d765f2f', 'volume_name': 'volume-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f', 'volume_size': 1, 'source_volid': '1fc6db94-7916-4baf-b58f-ae8c4f46c774', 'source_volstatus': 'available'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b586d20-802c-4083-b46b-95d88c8e258d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b586d20-802c-4083-b46b-95d88c8e258d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:12:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a29fcbd-9f47-4e34-9e67-9ae0891c9308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:12:56 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Volume 98f54cb4-bf3b-42b0-9e93-c95f5d765f2f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f', 'volume_size': 1, 'source_volid': '1fc6db94-7916-4baf-b58f-ae8c4f46c774', 'source_volstatus': 'available'}
Nov 05 15:12:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:12:56 devstack sudo[98367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1
Nov 05 15:12:56 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:12:56 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root
Nov 05 15:12:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1" returned: 0 in 0.416s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:12:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1 {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 15:12:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Creating direct copy from snapshot {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 15:12:56 devstack cinder-volume[87150]: DEBUG cinder.utils [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Path /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1139edef-02ef-410b-b5f4-528311caf4f1 not found in is_blk_device check {{(pid=87150) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 15:12:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1139edef-02ef-410b-b5f4-528311caf4f1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:12:56 devstack sudo[98372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1139edef-02ef-410b-b5f4-528311caf4f1
Nov 05 15:12:56 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:03 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1139edef-02ef-410b-b5f4-528311caf4f1" returned: 0 in 6.806s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:03 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Image conversion details: src /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1, size 1024.00 MB, duration 6.81 sec, destination /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1139edef-02ef-410b-b5f4-528311caf4f1 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:13:03 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Converted 1024.00 MB image at 150.42 MB/s
Nov 05 15:13:03 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1139edef-02ef-410b-b5f4-528311caf4f1 is being set with open permissions: ugo+rw
Nov 05 15:13:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1139edef-02ef-410b-b5f4-528311caf4f1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:03 devstack sudo[98388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1139edef-02ef-410b-b5f4-528311caf4f1
Nov 05 15:13:03 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:03 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1139edef-02ef-410b-b5f4-528311caf4f1" returned: 0 in 0.246s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-1139edef-02ef-410b-b5f4-528311caf4f1" released by "_copy_volume_from_snapshot" :: held 8.037s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-5bad4b08-e5f1-422d-9746-d57eb10c591d-1139edef-02ef-410b-b5f4-528311caf4f1" released by "_create_volume_from_snapshot" :: held 8.102s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.121s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 7.470s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:03 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Cloning volume 1fc6db94-7916-4baf-b58f-ae8c4f46c774 to volume 98f54cb4-bf3b-42b0-9e93-c95f5d765f2f
Nov 05 15:13:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d0b66b-ce52-4744-a6cb-e697e8d87840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1139edef-02ef-410b-b5f4-528311caf4f1', 'volume_size': 2, 'snapshot_id': '5bad4b08-e5f1-422d-9746-d57eb10c591d'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c48c52-a992-4615-aa72-4ba511184405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:03 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Volume volume-1139edef-02ef-410b-b5f4-528311caf4f1 (1139edef-02ef-410b-b5f4-528311caf4f1): created successfully
Nov 05 15:13:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c48c52-a992-4615-aa72-4ba511184405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Flow 'volume_create_manager' (0cff8193-8f45-4f33-a09a-db55097465aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:13:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Creating offline snapshot 9dcf871a-2a90-46b2-aa72-d74e6145175a of volume 1fc6db94-7916-4baf-b58f-ae8c4f46c774 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:13:03 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e1003d-b676-4f6b-a89a-e0e1e9ad1f75]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-47371382-40c3-46ef-b64c-b5d923f8f8d5 tempest-VolumesSnapshotTestJSON-1973636354 None] Created volume successfully.
Nov 05 15:13:03 devstack sudo[98391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774
Nov 05 15:13:03 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:04 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774" returned: 0 in 0.351s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.9dcf871a-2a90-46b2-aa72-d74e6145175a 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:04 devstack sudo[98396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.9dcf871a-2a90-46b2-aa72-d74e6145175a 1G
Nov 05 15:13:04 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-afefca08-6d31-4509-935f-bf72956e3264 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "cinder-1139edef-02ef-410b-b5f4-528311caf4f1-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-afefca08-6d31-4509-935f-bf72956e3264 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-1139edef-02ef-410b-b5f4-528311caf4f1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-afefca08-6d31-4509-935f-bf72956e3264 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "cinder-quobyte-1139edef-02ef-410b-b5f4-528311caf4f1" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-afefca08-6d31-4509-935f-bf72956e3264 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-1139edef-02ef-410b-b5f4-528311caf4f1" acquired by "delete_volume" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:04 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f0460f-03dd-43cc-9787-3b28b76cce87]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afefca08-6d31-4509-935f-bf72956e3264 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1139edef-02ef-410b-b5f4-528311caf4f1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:04 devstack sudo[98398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1139edef-02ef-410b-b5f4-528311caf4f1
Nov 05 15:13:04 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:04 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.9dcf871a-2a90-46b2-aa72-d74e6145175a 1G" returned: 0 in 0.439s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.9dcf871a-2a90-46b2-aa72-d74e6145175a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:04 devstack sudo[98404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.9dcf871a-2a90-46b2-aa72-d74e6145175a
Nov 05 15:13:04 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:04 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afefca08-6d31-4509-935f-bf72956e3264 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1139edef-02ef-410b-b5f4-528311caf4f1" returned: 0 in 0.389s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afefca08-6d31-4509-935f-bf72956e3264 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1139edef-02ef-410b-b5f4-528311caf4f1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:04 devstack sudo[98409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1139edef-02ef-410b-b5f4-528311caf4f1
Nov 05 15:13:04 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:04 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.9dcf871a-2a90-46b2-aa72-d74e6145175a" returned: 0 in 0.287s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:04 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.9dcf871a-2a90-46b2-aa72-d74e6145175a is being set with open permissions: ugo+rw
Nov 05 15:13:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.9dcf871a-2a90-46b2-aa72-d74e6145175a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:04 devstack sudo[98414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.9dcf871a-2a90-46b2-aa72-d74e6145175a
Nov 05 15:13:04 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:05 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afefca08-6d31-4509-935f-bf72956e3264 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1139edef-02ef-410b-b5f4-528311caf4f1" returned: 0 in 0.259s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-afefca08-6d31-4509-935f-bf72956e3264 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-1139edef-02ef-410b-b5f4-528311caf4f1" released by "delete_volume" :: held 0.695s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-afefca08-6d31-4509-935f-bf72956e3264 tempest-VolumesSnapshotTestJSON-1973636354 None] Created reservations ['f33409e2-add2-4d96-8956-acbd04da998f', '44b1cb7d-8972-4a2b-b573-7b5029691606', 'e296e481-434d-44ab-95e6-db3c10eb66cb', '87318b19-7093-4f0f-b5a1-42cf9593619d'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-afefca08-6d31-4509-935f-bf72956e3264 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-afefca08-6d31-4509-935f-bf72956e3264 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-afefca08-6d31-4509-935f-bf72956e3264 tempest-VolumesSnapshotTestJSON-1973636354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-afefca08-6d31-4509-935f-bf72956e3264 tempest-VolumesSnapshotTestJSON-1973636354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-afefca08-6d31-4509-935f-bf72956e3264 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afefca08-6d31-4509-935f-bf72956e3264 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:05 devstack sudo[98417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:13:05 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:05 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.9dcf871a-2a90-46b2-aa72-d74e6145175a" returned: 0 in 0.252s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:05 devstack sudo[98420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.info
Nov 05 15:13:05 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:05 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-afefca08-6d31-4509-935f-bf72956e3264 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.270s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-afefca08-6d31-4509-935f-bf72956e3264 tempest-VolumesSnapshotTestJSON-1973636354 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:13:05 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-afefca08-6d31-4509-935f-bf72956e3264 tempest-VolumesSnapshotTestJSON-1973636354 None] Deleted volume successfully.
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-afefca08-6d31-4509-935f-bf72956e3264 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-1139edef-02ef-410b-b5f4-528311caf4f1-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:05 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-722673f3-29fd-4890-9eb2-3deb265e5cf7 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "cinder-5bad4b08-e5f1-422d-9746-d57eb10c591d-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.info" returned: 0 in 0.287s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:05 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.info is being set with open permissions: ugo+rw
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-722673f3-29fd-4890-9eb2-3deb265e5cf7 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-5bad4b08-e5f1-422d-9746-d57eb10c591d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-722673f3-29fd-4890-9eb2-3deb265e5cf7 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "cinder-quobyte-00775a11-a00d-402d-97bd-4a545087cdc1" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:05 devstack sudo[98424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.info
Nov 05 15:13:05 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-722673f3-29fd-4890-9eb2-3deb265e5cf7 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-00775a11-a00d-402d-97bd-4a545087cdc1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-722673f3-29fd-4890-9eb2-3deb265e5cf7 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "cinder-quobyte-5bad4b08-e5f1-422d-9746-d57eb10c591d" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-722673f3-29fd-4890-9eb2-3deb265e5cf7 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-5bad4b08-e5f1-422d-9746-d57eb10c591d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-722673f3-29fd-4890-9eb2-3deb265e5cf7 tempest-VolumesSnapshotTestJSON-1973636354 None] Deleting offline snapshot 5bad4b08-e5f1-422d-9746-d57eb10c591d of volume 00775a11-a00d-402d-97bd-4a545087cdc1 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-722673f3-29fd-4890-9eb2-3deb265e5cf7 tempest-VolumesSnapshotTestJSON-1973636354 None] snapshot_file for this snap is: volume-00775a11-a00d-402d-97bd-4a545087cdc1.5bad4b08-e5f1-422d-9746-d57eb10c591d {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c0b187-9627-4e67-bca0-bb8f86ae5572]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-722673f3-29fd-4890-9eb2-3deb265e5cf7 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.5bad4b08-e5f1-422d-9746-d57eb10c591d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:05 devstack sudo[98426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.5bad4b08-e5f1-422d-9746-d57eb10c591d
Nov 05 15:13:05 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:05 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.info" returned: 0 in 0.283s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Acquiring lock "cinder-quobyte-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f" by "_copy_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Lock "cinder-quobyte-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] snapshot: 9dcf871a-2a90-46b2-aa72-d74e6145175a, volume: 98f54cb4-bf3b-42b0-9e93-c95f5d765f2f,  {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[743af0bf-6a69-4c75-8332-8b29e359efe4]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.9dcf871a-2a90-46b2-aa72-d74e6145175a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:06 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:06 devstack sudo[98429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.9dcf871a-2a90-46b2-aa72-d74e6145175a
Nov 05 15:13:06 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-722673f3-29fd-4890-9eb2-3deb265e5cf7 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.5bad4b08-e5f1-422d-9746-d57eb10c591d" returned: 0 in 0.416s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-722673f3-29fd-4890-9eb2-3deb265e5cf7 tempest-VolumesSnapshotTestJSON-1973636354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00775a11-a00d-402d-97bd-4a545087cdc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:13:06 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bab3c5d-8862-45df-82e3-c4c5c9597d25]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-722673f3-29fd-4890-9eb2-3deb265e5cf7 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:06 devstack sudo[98434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1
Nov 05 15:13:06 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:06 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.9dcf871a-2a90-46b2-aa72-d74e6145175a" returned: 0 in 0.422s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:13:06 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[481f0b35-6450-47a7-8d63-38e9321f7b48]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:06 devstack sudo[98439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774
Nov 05 15:13:06 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:06 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-722673f3-29fd-4890-9eb2-3deb265e5cf7 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1" returned: 0 in 0.560s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-722673f3-29fd-4890-9eb2-3deb265e5cf7 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.5bad4b08-e5f1-422d-9746-d57eb10c591d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:06 devstack sudo[98444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.5bad4b08-e5f1-422d-9746-d57eb10c591d
Nov 05 15:13:06 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:06 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774" returned: 0 in 0.396s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774 {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 15:13:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Creating direct copy from snapshot {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 15:13:06 devstack cinder-volume[87150]: DEBUG cinder.utils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Path /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f not found in is_blk_device check {{(pid=87150) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 15:13:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:06 devstack sudo[98449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f
Nov 05 15:13:06 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:07 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-722673f3-29fd-4890-9eb2-3deb265e5cf7 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.5bad4b08-e5f1-422d-9746-d57eb10c591d" returned: 0 in 0.357s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-722673f3-29fd-4890-9eb2-3deb265e5cf7 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.5bad4b08-e5f1-422d-9746-d57eb10c591d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:07 devstack sudo[98456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.5bad4b08-e5f1-422d-9746-d57eb10c591d
Nov 05 15:13:07 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:07 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-722673f3-29fd-4890-9eb2-3deb265e5cf7 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1.5bad4b08-e5f1-422d-9746-d57eb10c591d" returned: 0 in 0.328s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-722673f3-29fd-4890-9eb2-3deb265e5cf7 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-5bad4b08-e5f1-422d-9746-d57eb10c591d" released by "_delete_snapshot" :: held 1.845s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-722673f3-29fd-4890-9eb2-3deb265e5cf7 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-00775a11-a00d-402d-97bd-4a545087cdc1" released by "delete_snapshot" :: held 1.877s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:07 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-722673f3-29fd-4890-9eb2-3deb265e5cf7 tempest-VolumesSnapshotTestJSON-1973636354 None] Created reservations ['943318b2-f4a3-412d-8f90-7230daf58c69', '4f72f184-8314-43b1-acdd-cfc8d34231d6', 'b791f1d4-62e6-449a-ab7a-239249e3be97', '52e18399-e9fc-4642-90ed-53673b21ac7b'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:13:07 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=87,cinder:INSERT=18,cinder:UPDATE=76,cinder:DELETE=7 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:13:07 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-722673f3-29fd-4890-9eb2-3deb265e5cf7 tempest-VolumesSnapshotTestJSON-1973636354 None] Delete snapshot completed successfully.
Nov 05 15:13:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-722673f3-29fd-4890-9eb2-3deb265e5cf7 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-5bad4b08-e5f1-422d-9746-d57eb10c591d-delete_snapshot" released by "delete_snapshot" :: held 2.317s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d61f3e9f-d815-4d11-9c81-7ae4a8a291ba tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "cinder-00775a11-a00d-402d-97bd-4a545087cdc1-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d61f3e9f-d815-4d11-9c81-7ae4a8a291ba tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-00775a11-a00d-402d-97bd-4a545087cdc1-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:09 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=86,cinder:SELECT=67,cinder:DELETE=9,cinder:INSERT=23 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:13:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d61f3e9f-d815-4d11-9c81-7ae4a8a291ba tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "cinder-quobyte-00775a11-a00d-402d-97bd-4a545087cdc1" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d61f3e9f-d815-4d11-9c81-7ae4a8a291ba tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-00775a11-a00d-402d-97bd-4a545087cdc1" acquired by "delete_volume" :: waited 0.059s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:09 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d69abca-19d3-464c-8c1d-7beb2e463099]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d61f3e9f-d815-4d11-9c81-7ae4a8a291ba tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:09 devstack sudo[98472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1
Nov 05 15:13:09 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:10 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d61f3e9f-d815-4d11-9c81-7ae4a8a291ba tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1" returned: 0 in 0.739s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d61f3e9f-d815-4d11-9c81-7ae4a8a291ba tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:10 devstack sudo[98480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1
Nov 05 15:13:10 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:10 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d61f3e9f-d815-4d11-9c81-7ae4a8a291ba tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-00775a11-a00d-402d-97bd-4a545087cdc1" returned: 0 in 0.559s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d61f3e9f-d815-4d11-9c81-7ae4a8a291ba tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-00775a11-a00d-402d-97bd-4a545087cdc1" released by "delete_volume" :: held 1.511s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:10 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-d61f3e9f-d815-4d11-9c81-7ae4a8a291ba tempest-VolumesSnapshotTestJSON-1973636354 None] Created reservations ['30c242b5-7a46-405e-b610-8ad18689817b', '040ed922-3bd8-4ac5-9387-f13ef105adb6', '63907446-5de1-4430-bfba-2371aa32f10a', '23951627-fcad-4450-b610-1be2e12706bd'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:13:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-81d89a34-2bc1-449f-b886-899406b555f4 req-dbdd5587-ba07-4f85-a67d-e40ea3d1a280 tempest-TestStampPattern-527871853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d61f3e9f-d815-4d11-9c81-7ae4a8a291ba tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d61f3e9f-d815-4d11-9c81-7ae4a8a291ba tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d61f3e9f-d815-4d11-9c81-7ae4a8a291ba tempest-VolumesSnapshotTestJSON-1973636354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:13:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d61f3e9f-d815-4d11-9c81-7ae4a8a291ba tempest-VolumesSnapshotTestJSON-1973636354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:13:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d61f3e9f-d815-4d11-9c81-7ae4a8a291ba tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d61f3e9f-d815-4d11-9c81-7ae4a8a291ba tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:11 devstack sudo[98492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:13:11 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:11 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d61f3e9f-d815-4d11-9c81-7ae4a8a291ba tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.483s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:11 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-d61f3e9f-d815-4d11-9c81-7ae4a8a291ba tempest-VolumesSnapshotTestJSON-1973636354 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:13:11 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d61f3e9f-d815-4d11-9c81-7ae4a8a291ba tempest-VolumesSnapshotTestJSON-1973636354 None] Deleted volume successfully.
Nov 05 15:13:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d61f3e9f-d815-4d11-9c81-7ae4a8a291ba tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-00775a11-a00d-402d-97bd-4a545087cdc1-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:12 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:13:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Flow 'volume_create_manager' (c4fd7c15-adc4-4b49-9316-a17cef047e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:13:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8bd87d-b0fe-41fe-b7fc-bcd410c42fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8bd87d-b0fe-41fe-b7fc-bcd410c42fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1230507365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7d1f53b-99cd-45db-ab16-605fb0ad8d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827fdac216c3413fa74f5a72a55eaa06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:13:12Z,use_quota=True,user_id='8ca9c9ba0a6b4dd19c3a7ee9409b911c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f53b579b-5ec2-432c-89dd-36e02bec3d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f53b579b-5ec2-432c-89dd-36e02bec3d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1496be23-9aa2-4822-838d-8156b80d9153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1496be23-9aa2-4822-838d-8156b80d9153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7d1f53b-99cd-45db-ab16-605fb0ad8d3f', 'volume_name': 'volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f998e9-b21e-4d16-9b49-7d8cb8df2020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f998e9-b21e-4d16-9b49-7d8cb8df2020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80318dbf-b2c2-4857-acc0-3bf4b329f983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:12 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Volume a7d1f53b-99cd-45db-ab16-605fb0ad8d3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f', 'volume_size': 1}
Nov 05 15:13:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:14 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f" returned: 0 in 7.845s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:14 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Image conversion details: src /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774, size 1024.00 MB, duration 7.85 sec, destination /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:13:14 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Converted 1024.00 MB image at 130.52 MB/s
Nov 05 15:13:14 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f is being set with open permissions: ugo+rw
Nov 05 15:13:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:14 devstack sudo[98495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f
Nov 05 15:13:14 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:14 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f" returned: 0 in 0.230s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Lock "cinder-quobyte-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f" released by "_copy_volume_from_snapshot" :: held 8.998s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Acquiring lock "cinder-quobyte-9dcf871a-2a90-46b2-aa72-d74e6145175a" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Lock "cinder-quobyte-9dcf871a-2a90-46b2-aa72-d74e6145175a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Deleting offline snapshot 9dcf871a-2a90-46b2-aa72-d74e6145175a of volume 1fc6db94-7916-4baf-b58f-ae8c4f46c774 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:13:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] snapshot_file for this snap is: volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.9dcf871a-2a90-46b2-aa72-d74e6145175a {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:13:14 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2874b561-61cb-494d-a258-f39119f5e2fe]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.9dcf871a-2a90-46b2-aa72-d74e6145175a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:15 devstack sudo[98498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.9dcf871a-2a90-46b2-aa72-d74e6145175a
Nov 05 15:13:15 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:15 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.9dcf871a-2a90-46b2-aa72-d74e6145175a" returned: 0 in 0.357s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:13:15 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd57a46-c8e3-4ddd-9f29-c37d3bf24afd]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:15 devstack sudo[98504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774
Nov 05 15:13:15 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:15 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774" returned: 0 in 0.506s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.9dcf871a-2a90-46b2-aa72-d74e6145175a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:15 devstack sudo[98509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.9dcf871a-2a90-46b2-aa72-d74e6145175a
Nov 05 15:13:15 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:16 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.9dcf871a-2a90-46b2-aa72-d74e6145175a" returned: 0 in 0.352s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.9dcf871a-2a90-46b2-aa72-d74e6145175a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:16 devstack sudo[98514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.9dcf871a-2a90-46b2-aa72-d74e6145175a
Nov 05 15:13:16 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:16 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774.9dcf871a-2a90-46b2-aa72-d74e6145175a" returned: 0 in 0.239s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Lock "cinder-quobyte-9dcf871a-2a90-46b2-aa72-d74e6145175a" released by "_delete_snapshot" :: held 1.551s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.668s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-81d89a34-2bc1-449f-b886-899406b555f4 req-dbdd5587-ba07-4f85-a67d-e40ea3d1a280 tempest-TestStampPattern-527871853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.537s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-81d89a34-2bc1-449f-b886-899406b555f4 req-dbdd5587-ba07-4f85-a67d-e40ea3d1a280 tempest-TestStampPattern-527871853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.902s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1230507365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7d1f53b-99cd-45db-ab16-605fb0ad8d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827fdac216c3413fa74f5a72a55eaa06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:13:12Z,use_quota=True,user_id='8ca9c9ba0a6b4dd19c3a7ee9409b911c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:13:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Creating volume a7d1f53b-99cd-45db-ab16-605fb0ad8d3f {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:13:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:13:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:13:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:13:16 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:13:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a29fcbd-9f47-4e34-9e67-9ae0891c9308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f', 'volume_size': 1, 'source_volid': '1fc6db94-7916-4baf-b58f-ae8c4f46c774', 'source_volstatus': 'available'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8c4078-a3d5-47f3-bb51-fbf6ec424970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:16 devstack sudo[98517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f 1073741824
Nov 05 15:13:16 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:16 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Volume volume-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f (98f54cb4-bf3b-42b0-9e93-c95f5d765f2f): created successfully
Nov 05 15:13:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8c4078-a3d5-47f3-bb51-fbf6ec424970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Flow 'volume_create_manager' (befe74b7-860e-488c-a356-bf853b65c61a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:13:16 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-59a676c2-8304-4564-bb94-d249e7c5b691 tempest-VolumesGetTest-1228684426 None] Created volume successfully.
Nov 05 15:13:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-81d89a34-2bc1-449f-b886-899406b555f4 req-dbdd5587-ba07-4f85-a67d-e40ea3d1a280 tempest-TestStampPattern-527871853 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628', 'name': 'volume-33f1227c-951f-4d55-a886-9135102a4c3f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c616135f-41c3-4e8e-ae6c-4e074730555f', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 15:13:16 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-81d89a34-2bc1-449f-b886-899406b555f4 req-dbdd5587-ba07-4f85-a67d-e40ea3d1a280 tempest-TestStampPattern-527871853 None] attachment_update completed successfully.
Nov 05 15:13:17 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f 1073741824" returned: 0 in 0.581s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:17 devstack sudo[98939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f
Nov 05 15:13:17 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:17 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f" returned: 0 in 0.303s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80318dbf-b2c2-4857-acc0-3bf4b329f983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c901c94-e58d-4b18-9df1-76a2229f6821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:17 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Volume volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f (a7d1f53b-99cd-45db-ab16-605fb0ad8d3f): created successfully
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c901c94-e58d-4b18-9df1-76a2229f6821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Flow 'volume_create_manager' (c4fd7c15-adc4-4b49-9316-a17cef047e2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:13:17 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-49a4bce0-bea1-450d-ae8c-d08993e1e232 tempest-VolumesSnapshotTestJSON-1973636354 None] Created volume successfully.
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Flow 'volume_create_manager' (71799165-0952-4ca5-a1ee-b285b4cbca7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80491f20-fe76-4efe-987e-987b9c215f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80491f20-fe76-4efe-987e-987b9c215f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:13:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1210484870',display_name='tempest-VolumesGetTest-Volume-20856930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1746d71-a2ab-4591-9acf-fd445a86cb6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2c00ed0df04d6889a72fafaf210c83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:13:18Z,use_quota=True,user_id='05423723a9d14c8abb97f22387c6e2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5c1bc5-8bb8-4325-901b-9a7c15bb8d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5c1bc5-8bb8-4325-901b-9a7c15bb8d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (499119e5-c077-433f-99d0-df352b826999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (499119e5-c077-433f-99d0-df352b826999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1746d71-a2ab-4591-9acf-fd445a86cb6a', 'volume_name': 'volume-e1746d71-a2ab-4591-9acf-fd445a86cb6a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53c542c-ba80-40b3-abca-9898170d11d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53c542c-ba80-40b3-abca-9898170d11d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28305627-94c4-4519-bdfb-f80a9a934425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:17 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Volume e1746d71-a2ab-4591-9acf-fd445a86cb6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1746d71-a2ab-4591-9acf-fd445a86cb6a', 'volume_size': 1}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:13:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1210484870',display_name='tempest-VolumesGetTest-Volume-20856930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1746d71-a2ab-4591-9acf-fd445a86cb6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2c00ed0df04d6889a72fafaf210c83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:13:18Z,use_quota=True,user_id='05423723a9d14c8abb97f22387c6e2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Creating volume e1746d71-a2ab-4591-9acf-fd445a86cb6a {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:13:17 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e1746d71-a2ab-4591-9acf-fd445a86cb6a 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:17 devstack sudo[98946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e1746d71-a2ab-4591-9acf-fd445a86cb6a 1073741824
Nov 05 15:13:17 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1d5f22e1-a94e-4105-917e-77144e658a95 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:18 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e1746d71-a2ab-4591-9acf-fd445a86cb6a 1073741824" returned: 0 in 0.458s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e1746d71-a2ab-4591-9acf-fd445a86cb6a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:18 devstack sudo[98962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e1746d71-a2ab-4591-9acf-fd445a86cb6a
Nov 05 15:13:18 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:18 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e1746d71-a2ab-4591-9acf-fd445a86cb6a" returned: 0 in 0.312s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:13:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1d5f22e1-a94e-4105-917e-77144e658a95 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.626s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28305627-94c4-4519-bdfb-f80a9a934425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1746d71-a2ab-4591-9acf-fd445a86cb6a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef44510d-2119-4037-a27a-a5ce1cdbb12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1d5f22e1-a94e-4105-917e-77144e658a95 tempest-VolumesSnapshotTestJSON-1973636354 None] Creating offline snapshot c7332fd0-5cf7-4d39-b764-c580dcf69319 of volume a7d1f53b-99cd-45db-ab16-605fb0ad8d3f {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:13:18 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Volume volume-e1746d71-a2ab-4591-9acf-fd445a86cb6a (e1746d71-a2ab-4591-9acf-fd445a86cb6a): created successfully
Nov 05 15:13:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef44510d-2119-4037-a27a-a5ce1cdbb12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Flow 'volume_create_manager' (71799165-0952-4ca5-a1ee-b285b4cbca7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:13:18 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[91279801-445e-4d2e-b26c-91ef45cc7771]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d5f22e1-a94e-4105-917e-77144e658a95 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-42cfbb93-1710-4bd2-a7a4-4b75bd91ee8a tempest-VolumesGetTest-1228684426 None] Created volume successfully.
Nov 05 15:13:18 devstack sudo[99003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f
Nov 05 15:13:18 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:19 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d5f22e1-a94e-4105-917e-77144e658a95 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f" returned: 0 in 0.483s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d5f22e1-a94e-4105-917e-77144e658a95 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.c7332fd0-5cf7-4d39-b764-c580dcf69319 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:19 devstack sudo[99012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.c7332fd0-5cf7-4d39-b764-c580dcf69319 1G
Nov 05 15:13:19 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:19 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-6fd86717-904c-4835-93fb-e9665df11e5f req-8d22cc74-6ec0-4d89-b2bd-f13b8a358e67 tempest-TestStampPattern-527871853 None] Terminate volume connection completed successfully.
Nov 05 15:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-6fd86717-904c-4835-93fb-e9665df11e5f req-8d22cc74-6ec0-4d89-b2bd-f13b8a358e67 tempest-TestStampPattern-527871853 None] Deleting attachment c616135f-41c3-4e8e-ae6c-4e074730555f. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 15:13:19 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d5f22e1-a94e-4105-917e-77144e658a95 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.c7332fd0-5cf7-4d39-b764-c580dcf69319 1G" returned: 0 in 0.466s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d5f22e1-a94e-4105-917e-77144e658a95 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.c7332fd0-5cf7-4d39-b764-c580dcf69319 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:19 devstack sudo[99043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.c7332fd0-5cf7-4d39-b764-c580dcf69319
Nov 05 15:13:19 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f74a9bca-e04c-4d7b-b40f-f4164a50eeb2 tempest-VolumesGetTest-1228684426 None] Acquiring lock "cinder-e1746d71-a2ab-4591-9acf-fd445a86cb6a-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f74a9bca-e04c-4d7b-b40f-f4164a50eeb2 tempest-VolumesGetTest-1228684426 None] Lock "cinder-e1746d71-a2ab-4591-9acf-fd445a86cb6a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f74a9bca-e04c-4d7b-b40f-f4164a50eeb2 tempest-VolumesGetTest-1228684426 None] Acquiring lock "cinder-quobyte-e1746d71-a2ab-4591-9acf-fd445a86cb6a" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:19 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d5f22e1-a94e-4105-917e-77144e658a95 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.c7332fd0-5cf7-4d39-b764-c580dcf69319" returned: 0 in 0.351s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:19 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-1d5f22e1-a94e-4105-917e-77144e658a95 tempest-VolumesSnapshotTestJSON-1973636354 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.c7332fd0-5cf7-4d39-b764-c580dcf69319 is being set with open permissions: ugo+rw
Nov 05 15:13:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d5f22e1-a94e-4105-917e-77144e658a95 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.c7332fd0-5cf7-4d39-b764-c580dcf69319 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f74a9bca-e04c-4d7b-b40f-f4164a50eeb2 tempest-VolumesGetTest-1228684426 None] Lock "cinder-quobyte-e1746d71-a2ab-4591-9acf-fd445a86cb6a" acquired by "delete_volume" :: waited 0.039s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:20 devstack sudo[99050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.c7332fd0-5cf7-4d39-b764-c580dcf69319
Nov 05 15:13:20 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:20 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ea4333-aa5a-486f-bd33-a152f7b26354]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f74a9bca-e04c-4d7b-b40f-f4164a50eeb2 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e1746d71-a2ab-4591-9acf-fd445a86cb6a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:20 devstack sudo[99052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e1746d71-a2ab-4591-9acf-fd445a86cb6a
Nov 05 15:13:20 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:20 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d5f22e1-a94e-4105-917e-77144e658a95 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.c7332fd0-5cf7-4d39-b764-c580dcf69319" returned: 0 in 0.341s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d5f22e1-a94e-4105-917e-77144e658a95 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:20 devstack sudo[99055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.info
Nov 05 15:13:20 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:20 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f74a9bca-e04c-4d7b-b40f-f4164a50eeb2 tempest-VolumesGetTest-1228684426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e1746d71-a2ab-4591-9acf-fd445a86cb6a" returned: 0 in 0.552s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f74a9bca-e04c-4d7b-b40f-f4164a50eeb2 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e1746d71-a2ab-4591-9acf-fd445a86cb6a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:20 devstack sudo[99066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e1746d71-a2ab-4591-9acf-fd445a86cb6a
Nov 05 15:13:20 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:20 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d5f22e1-a94e-4105-917e-77144e658a95 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.info" returned: 0 in 0.374s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:20 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-1d5f22e1-a94e-4105-917e-77144e658a95 tempest-VolumesSnapshotTestJSON-1973636354 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.info is being set with open permissions: ugo+rw
Nov 05 15:13:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d5f22e1-a94e-4105-917e-77144e658a95 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:20 devstack sudo[99073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.info
Nov 05 15:13:20 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:21 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f74a9bca-e04c-4d7b-b40f-f4164a50eeb2 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e1746d71-a2ab-4591-9acf-fd445a86cb6a" returned: 0 in 0.495s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f74a9bca-e04c-4d7b-b40f-f4164a50eeb2 tempest-VolumesGetTest-1228684426 None] Lock "cinder-quobyte-e1746d71-a2ab-4591-9acf-fd445a86cb6a" released by "delete_volume" :: held 1.127s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:21 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-f74a9bca-e04c-4d7b-b40f-f4164a50eeb2 tempest-VolumesGetTest-1228684426 None] Created reservations ['0e54584f-54fb-4cc2-a714-3ce8dc8c2abd', '830cbc9d-e3a7-4075-8acf-49058572bbe0', '7d01293c-af53-41ca-9ff5-ec92519d7cb5', '42dfa95e-d1de-4e27-aa6f-30d155eb5a7f'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:13:21 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d5f22e1-a94e-4105-917e-77144e658a95 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.info" returned: 0 in 0.566s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1d5f22e1-a94e-4105-917e-77144e658a95 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.761s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:21 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1d5f22e1-a94e-4105-917e-77144e658a95 tempest-VolumesSnapshotTestJSON-1973636354 None] Create snapshot completed successfully
Nov 05 15:13:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f74a9bca-e04c-4d7b-b40f-f4164a50eeb2 tempest-VolumesGetTest-1228684426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f74a9bca-e04c-4d7b-b40f-f4164a50eeb2 tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f74a9bca-e04c-4d7b-b40f-f4164a50eeb2 tempest-VolumesGetTest-1228684426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:13:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f74a9bca-e04c-4d7b-b40f-f4164a50eeb2 tempest-VolumesGetTest-1228684426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:13:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f74a9bca-e04c-4d7b-b40f-f4164a50eeb2 tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f74a9bca-e04c-4d7b-b40f-f4164a50eeb2 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:21 devstack sudo[99091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:13:21 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:21 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f74a9bca-e04c-4d7b-b40f-f4164a50eeb2 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.391s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:21 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-f74a9bca-e04c-4d7b-b40f-f4164a50eeb2 tempest-VolumesGetTest-1228684426 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:13:21 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f74a9bca-e04c-4d7b-b40f-f4164a50eeb2 tempest-VolumesGetTest-1228684426 None] Deleted volume successfully.
Nov 05 15:13:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f74a9bca-e04c-4d7b-b40f-f4164a50eeb2 tempest-VolumesGetTest-1228684426 None] Lock "cinder-e1746d71-a2ab-4591-9acf-fd445a86cb6a-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8d3e8ea7-6156-4777-8046-be277ced2886 tempest-VolumesGetTest-1228684426 None] Acquiring lock "cinder-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8d3e8ea7-6156-4777-8046-be277ced2886 tempest-VolumesGetTest-1228684426 None] Lock "cinder-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8d3e8ea7-6156-4777-8046-be277ced2886 tempest-VolumesGetTest-1228684426 None] Acquiring lock "cinder-quobyte-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8d3e8ea7-6156-4777-8046-be277ced2886 tempest-VolumesGetTest-1228684426 None] Lock "cinder-quobyte-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f" acquired by "delete_volume" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:22 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2701cc61-6736-4e2c-afcc-0d5a70fe6701]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8d3e8ea7-6156-4777-8046-be277ced2886 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:22 devstack sudo[99117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f
Nov 05 15:13:22 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:13:23 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8d3e8ea7-6156-4777-8046-be277ced2886 tempest-VolumesGetTest-1228684426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f" returned: 0 in 0.817s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8d3e8ea7-6156-4777-8046-be277ced2886 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:23 devstack sudo[99126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f
Nov 05 15:13:23 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Flow 'volume_create_manager' (122e127c-16d5-48c7-93e1-9d0ff0f3f9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981fede1-4cbb-490a-970d-a2992f254c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981fede1-4cbb-490a-970d-a2992f254c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-8510178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06dbb477-5708-4e93-bd2c-0e96792f11b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827fdac216c3413fa74f5a72a55eaa06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c7332fd0-5cf7-4d39-b764-c580dcf69319,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:13:23Z,use_quota=True,user_id='8ca9c9ba0a6b4dd19c3a7ee9409b911c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54791b44-6ded-46e5-b516-9102446b9163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54791b44-6ded-46e5-b516-9102446b9163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0426e803-3096-4e06-bcbf-5cc8f3362dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0426e803-3096-4e06-bcbf-5cc8f3362dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '06dbb477-5708-4e93-bd2c-0e96792f11b0', 'volume_name': 'volume-06dbb477-5708-4e93-bd2c-0e96792f11b0', 'volume_size': 1, 'snapshot_id': 'c7332fd0-5cf7-4d39-b764-c580dcf69319'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359e0cb5-61f2-4d9f-b9c3-495c9ae19042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359e0cb5-61f2-4d9f-b9c3-495c9ae19042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827901b3-6289-43ec-8497-18863892c810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:23 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Volume 06dbb477-5708-4e93-bd2c-0e96792f11b0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-06dbb477-5708-4e93-bd2c-0e96792f11b0', 'volume_size': 1, 'snapshot_id': 'c7332fd0-5cf7-4d39-b764-c580dcf69319'}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "cinder-quobyte-c7332fd0-5cf7-4d39-b764-c580dcf69319-06dbb477-5708-4e93-bd2c-0e96792f11b0" by "_create_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-c7332fd0-5cf7-4d39-b764-c580dcf69319-06dbb477-5708-4e93-bd2c-0e96792f11b0" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Creating volume 06dbb477-5708-4e93-bd2c-0e96792f11b0 from snapshot c7332fd0-5cf7-4d39-b764-c580dcf69319 {{(pid=87150) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "cinder-quobyte-06dbb477-5708-4e93-bd2c-0e96792f11b0" by "_copy_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-06dbb477-5708-4e93-bd2c-0e96792f11b0" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] snapshot: c7332fd0-5cf7-4d39-b764-c580dcf69319, volume: 06dbb477-5708-4e93-bd2c-0e96792f11b0,  {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[05447dff-65b5-4229-8834-e661d697f705]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.c7332fd0-5cf7-4d39-b764-c580dcf69319 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:23 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8d3e8ea7-6156-4777-8046-be277ced2886 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f" returned: 0 in 0.550s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8d3e8ea7-6156-4777-8046-be277ced2886 tempest-VolumesGetTest-1228684426 None] Lock "cinder-quobyte-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f" released by "delete_volume" :: held 1.435s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:24 devstack sudo[99129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.c7332fd0-5cf7-4d39-b764-c580dcf69319
Nov 05 15:13:24 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:24 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-8d3e8ea7-6156-4777-8046-be277ced2886 tempest-VolumesGetTest-1228684426 None] Created reservations ['b0423e9b-8dd5-4ff4-9f9b-1977c08cac5a', '8495e0eb-b6ce-4f77-ac43-d17f5108877e', 'ec4edb5e-a0b3-4053-b5c8-4614d4ee6d2c', 'fbccaa82-e5ba-4549-9a5f-25d51ed7622f'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:13:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8d3e8ea7-6156-4777-8046-be277ced2886 tempest-VolumesGetTest-1228684426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8d3e8ea7-6156-4777-8046-be277ced2886 tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8d3e8ea7-6156-4777-8046-be277ced2886 tempest-VolumesGetTest-1228684426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:13:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8d3e8ea7-6156-4777-8046-be277ced2886 tempest-VolumesGetTest-1228684426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:13:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8d3e8ea7-6156-4777-8046-be277ced2886 tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8d3e8ea7-6156-4777-8046-be277ced2886 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:24 devstack sudo[99133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:13:24 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:24 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.c7332fd0-5cf7-4d39-b764-c580dcf69319" returned: 0 in 0.653s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:13:24 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[70897fd6-3135-4c08-9e1b-cb197b35f989]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:24 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8d3e8ea7-6156-4777-8046-be277ced2886 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.393s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:24 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-8d3e8ea7-6156-4777-8046-be277ced2886 tempest-VolumesGetTest-1228684426 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:13:24 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-8d3e8ea7-6156-4777-8046-be277ced2886 tempest-VolumesGetTest-1228684426 None] Deleted volume successfully.
Nov 05 15:13:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8d3e8ea7-6156-4777-8046-be277ced2886 tempest-VolumesGetTest-1228684426 None] Lock "cinder-98f54cb4-bf3b-42b0-9e93-c95f5d765f2f-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:24 devstack sudo[99139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f
Nov 05 15:13:24 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a806175c-1dce-45c4-8fa3-a2b85b4918cb tempest-VolumesGetTest-1228684426 None] Acquiring lock "cinder-1fc6db94-7916-4baf-b58f-ae8c4f46c774-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a806175c-1dce-45c4-8fa3-a2b85b4918cb tempest-VolumesGetTest-1228684426 None] Lock "cinder-1fc6db94-7916-4baf-b58f-ae8c4f46c774-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a806175c-1dce-45c4-8fa3-a2b85b4918cb tempest-VolumesGetTest-1228684426 None] Acquiring lock "cinder-quobyte-1fc6db94-7916-4baf-b58f-ae8c4f46c774" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a806175c-1dce-45c4-8fa3-a2b85b4918cb tempest-VolumesGetTest-1228684426 None] Lock "cinder-quobyte-1fc6db94-7916-4baf-b58f-ae8c4f46c774" acquired by "delete_volume" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:25 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f" returned: 0 in 0.485s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 15:13:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Creating direct copy from snapshot {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 15:13:25 devstack cinder-volume[87150]: DEBUG cinder.utils [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Path /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06dbb477-5708-4e93-bd2c-0e96792f11b0 not found in is_blk_device check {{(pid=87150) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 15:13:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06dbb477-5708-4e93-bd2c-0e96792f11b0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:25 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[662e6ce0-bce4-4440-bd46-bfbea6de38e1]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a806175c-1dce-45c4-8fa3-a2b85b4918cb tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:25 devstack sudo[99144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06dbb477-5708-4e93-bd2c-0e96792f11b0
Nov 05 15:13:25 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:25 devstack sudo[99145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774
Nov 05 15:13:25 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:25 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a806175c-1dce-45c4-8fa3-a2b85b4918cb tempest-VolumesGetTest-1228684426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774" returned: 0 in 0.460s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a806175c-1dce-45c4-8fa3-a2b85b4918cb tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:25 devstack sudo[99155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774
Nov 05 15:13:25 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2eaad88c-9a1f-440a-ba7a-073ba4606ff7 tempest-TestStampPattern-527871853 None] Acquiring lock "cinder-33f1227c-951f-4d55-a886-9135102a4c3f-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2eaad88c-9a1f-440a-ba7a-073ba4606ff7 tempest-TestStampPattern-527871853 None] Lock "cinder-33f1227c-951f-4d55-a886-9135102a4c3f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2eaad88c-9a1f-440a-ba7a-073ba4606ff7 tempest-TestStampPattern-527871853 None] Acquiring lock "cinder-quobyte-33f1227c-951f-4d55-a886-9135102a4c3f" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2eaad88c-9a1f-440a-ba7a-073ba4606ff7 tempest-TestStampPattern-527871853 None] Lock "cinder-quobyte-33f1227c-951f-4d55-a886-9135102a4c3f" acquired by "delete_volume" :: waited 0.057s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:25 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fda99d-3171-41b4-9623-0e73403f70ab]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2eaad88c-9a1f-440a-ba7a-073ba4606ff7 tempest-TestStampPattern-527871853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-33f1227c-951f-4d55-a886-9135102a4c3f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:25 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a806175c-1dce-45c4-8fa3-a2b85b4918cb tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1fc6db94-7916-4baf-b58f-ae8c4f46c774" returned: 0 in 0.443s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a806175c-1dce-45c4-8fa3-a2b85b4918cb tempest-VolumesGetTest-1228684426 None] Lock "cinder-quobyte-1fc6db94-7916-4baf-b58f-ae8c4f46c774" released by "delete_volume" :: held 1.017s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:26 devstack sudo[99164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-33f1227c-951f-4d55-a886-9135102a4c3f
Nov 05 15:13:26 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:26 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-a806175c-1dce-45c4-8fa3-a2b85b4918cb tempest-VolumesGetTest-1228684426 None] Created reservations ['289f5e0b-55d4-46b2-b182-1a155410961b', '537b790f-807a-47b5-ac8d-4babb425013e', 'e5b375f3-e6fd-432b-a3d2-05935b2db98b', 'd7d637b9-a6e9-43e2-9bc9-c5895936e6cf'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:13:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a806175c-1dce-45c4-8fa3-a2b85b4918cb tempest-VolumesGetTest-1228684426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a806175c-1dce-45c4-8fa3-a2b85b4918cb tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a806175c-1dce-45c4-8fa3-a2b85b4918cb tempest-VolumesGetTest-1228684426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:13:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a806175c-1dce-45c4-8fa3-a2b85b4918cb tempest-VolumesGetTest-1228684426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:13:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a806175c-1dce-45c4-8fa3-a2b85b4918cb tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a806175c-1dce-45c4-8fa3-a2b85b4918cb tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:26 devstack sudo[99166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:13:26 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:26 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a806175c-1dce-45c4-8fa3-a2b85b4918cb tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.597s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:26 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a806175c-1dce-45c4-8fa3-a2b85b4918cb tempest-VolumesGetTest-1228684426 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:13:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a806175c-1dce-45c4-8fa3-a2b85b4918cb tempest-VolumesGetTest-1228684426 None] Deleted volume successfully.
Nov 05 15:13:26 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a806175c-1dce-45c4-8fa3-a2b85b4918cb tempest-VolumesGetTest-1228684426 None] Lock "cinder-1fc6db94-7916-4baf-b58f-ae8c4f46c774-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2eaad88c-9a1f-440a-ba7a-073ba4606ff7 tempest-TestStampPattern-527871853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-33f1227c-951f-4d55-a886-9135102a4c3f" returned: 0 in 1.119s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2eaad88c-9a1f-440a-ba7a-073ba4606ff7 tempest-TestStampPattern-527871853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-33f1227c-951f-4d55-a886-9135102a4c3f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:27 devstack sudo[99172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-33f1227c-951f-4d55-a886-9135102a4c3f
Nov 05 15:13:27 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:27 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2eaad88c-9a1f-440a-ba7a-073ba4606ff7 tempest-TestStampPattern-527871853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-33f1227c-951f-4d55-a886-9135102a4c3f" returned: 0 in 0.361s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2eaad88c-9a1f-440a-ba7a-073ba4606ff7 tempest-TestStampPattern-527871853 None] Lock "cinder-quobyte-33f1227c-951f-4d55-a886-9135102a4c3f" released by "delete_volume" :: held 1.586s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:27 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-2eaad88c-9a1f-440a-ba7a-073ba4606ff7 tempest-TestStampPattern-527871853 None] Created reservations ['4f69cbb1-0929-4277-800b-d7d90a51a689', 'f9d7a1f9-faef-4712-ae65-f187f4c1b4db', '1e510b92-55d0-426c-a03e-1bf7fe05c2cd', '16f0c713-3833-4b73-842d-77c95b2dec59'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:13:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2eaad88c-9a1f-440a-ba7a-073ba4606ff7 tempest-TestStampPattern-527871853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2eaad88c-9a1f-440a-ba7a-073ba4606ff7 tempest-TestStampPattern-527871853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2eaad88c-9a1f-440a-ba7a-073ba4606ff7 tempest-TestStampPattern-527871853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:13:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2eaad88c-9a1f-440a-ba7a-073ba4606ff7 tempest-TestStampPattern-527871853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:13:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2eaad88c-9a1f-440a-ba7a-073ba4606ff7 tempest-TestStampPattern-527871853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2eaad88c-9a1f-440a-ba7a-073ba4606ff7 tempest-TestStampPattern-527871853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:27 devstack sudo[99175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:13:27 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:28 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2eaad88c-9a1f-440a-ba7a-073ba4606ff7 tempest-TestStampPattern-527871853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.738s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:28 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-2eaad88c-9a1f-440a-ba7a-073ba4606ff7 tempest-TestStampPattern-527871853 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:13:28 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2eaad88c-9a1f-440a-ba7a-073ba4606ff7 tempest-TestStampPattern-527871853 None] Deleted volume successfully.
Nov 05 15:13:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2eaad88c-9a1f-440a-ba7a-073ba4606ff7 tempest-TestStampPattern-527871853 None] Lock "cinder-33f1227c-951f-4d55-a886-9135102a4c3f-delete_volume" released by "delete_volume" :: held 2.950s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-42ea55f8-a3cd-46c0-b178-e1b6126ee974 tempest-TestStampPattern-527871853 None] Acquiring lock "cinder-7f0ae11e-eaaa-421f-8b4e-34f782449bea-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-42ea55f8-a3cd-46c0-b178-e1b6126ee974 tempest-TestStampPattern-527871853 None] Lock "cinder-7f0ae11e-eaaa-421f-8b4e-34f782449bea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.081s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-42ea55f8-a3cd-46c0-b178-e1b6126ee974 tempest-TestStampPattern-527871853 None] Acquiring lock "cinder-quobyte-c477a72e-838b-4440-b234-e27ce72c9768" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:28 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Flow 'volume_create_manager' (f4fe5441-bb40-4c28-b5b0-5dcfeb80dd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f173f481-1606-4411-b409-c98ffe3dd03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-42ea55f8-a3cd-46c0-b178-e1b6126ee974 tempest-TestStampPattern-527871853 None] Lock "cinder-quobyte-c477a72e-838b-4440-b234-e27ce72c9768" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-42ea55f8-a3cd-46c0-b178-e1b6126ee974 tempest-TestStampPattern-527871853 None] Acquiring lock "cinder-quobyte-7f0ae11e-eaaa-421f-8b4e-34f782449bea" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f173f481-1606-4411-b409-c98ffe3dd03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1925675041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b36638d8-138c-4729-8ee7-869f4d1c33eb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0d2c00ed0df04d6889a72fafaf210c83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:13:29Z,use_quota=True,user_id='05423723a9d14c8abb97f22387c6e2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b77f3b-4fb5-48d2-9bd3-31850a193a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b77f3b-4fb5-48d2-9bd3-31850a193a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e022a9c-a159-4cd4-bd41-920b5ceeb4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:29 devstack cinder-volume[87150]: DEBUG cinder.image.glance [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Creating Keystone auth plugin from conf {{(pid=87150) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 15:13:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-42ea55f8-a3cd-46c0-b178-e1b6126ee974 tempest-TestStampPattern-527871853 None] Lock "cinder-quobyte-7f0ae11e-eaaa-421f-8b4e-34f782449bea" acquired by "_delete_snapshot" :: waited 0.072s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-42ea55f8-a3cd-46c0-b178-e1b6126ee974 tempest-TestStampPattern-527871853 None] Deleting offline snapshot 7f0ae11e-eaaa-421f-8b4e-34f782449bea of volume c477a72e-838b-4440-b234-e27ce72c9768 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-42ea55f8-a3cd-46c0-b178-e1b6126ee974 tempest-TestStampPattern-527871853 None] snapshot_file for this snap is: volume-c477a72e-838b-4440-b234-e27ce72c9768.7f0ae11e-eaaa-421f-8b4e-34f782449bea {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:13:29 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ed8981-1d17-4d0e-97ab-500b51f57292]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-42ea55f8-a3cd-46c0-b178-e1b6126ee974 tempest-TestStampPattern-527871853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.7f0ae11e-eaaa-421f-8b4e-34f782449bea {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:29 devstack sudo[99179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.7f0ae11e-eaaa-421f-8b4e-34f782449bea
Nov 05 15:13:29 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e022a9c-a159-4cd4-bd41-920b5ceeb4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b36638d8-138c-4729-8ee7-869f4d1c33eb', 'volume_name': 'volume-b36638d8-138c-4729-8ee7-869f4d1c33eb', 'volume_size': 1, 'image_id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4a6a2406cd83415e894eebbb1d6b51ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'created_at': datetime.datetime(2026, 11, 5, 13, 57, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21a5d804-2425-4adb-8e07-60d978b4be84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfad93359d0>}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7884f1f5-05fe-4e9c-8318-4304dce018f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7884f1f5-05fe-4e9c-8318-4304dce018f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac23a144-67d5-4f2e-b35d-29da504ac22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:29 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Volume b36638d8-138c-4729-8ee7-869f4d1c33eb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b36638d8-138c-4729-8ee7-869f4d1c33eb', 'volume_size': 1, 'image_id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4a6a2406cd83415e894eebbb1d6b51ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'created_at': datetime.datetime(2026, 11, 5, 13, 57, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21a5d804-2425-4adb-8e07-60d978b4be84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfad93359d0>}
Nov 05 15:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Trying to clone b36638d8-138c-4729-8ee7-869f4d1c33eb from image 21a5d804-2425-4adb-8e07-60d978b4be84 at location (None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}]). {{(pid=87150) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 15:13:30 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-42ea55f8-a3cd-46c0-b178-e1b6126ee974 tempest-TestStampPattern-527871853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.7f0ae11e-eaaa-421f-8b4e-34f782449bea" returned: 0 in 0.863s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-42ea55f8-a3cd-46c0-b178-e1b6126ee974 tempest-TestStampPattern-527871853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c477a72e-838b-4440-b234-e27ce72c9768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:13:30 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b08cf8-5d7a-49f0-ac66-409f28ffc477]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-42ea55f8-a3cd-46c0-b178-e1b6126ee974 tempest-TestStampPattern-527871853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:30 devstack sudo[99184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768
Nov 05 15:13:30 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:30 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_iasi9xl7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 15:13:30 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 15:13:30 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e227923b-44d8-4a50-8009-07b1d4554384]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_iasi9xl7devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:31 devstack sudo[99191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_iasi9xl7devstack@QuobyteHD
Nov 05 15:13:31 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:31 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-42ea55f8-a3cd-46c0-b178-e1b6126ee974 tempest-TestStampPattern-527871853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768" returned: 0 in 0.994s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-42ea55f8-a3cd-46c0-b178-e1b6126ee974 tempest-TestStampPattern-527871853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.7f0ae11e-eaaa-421f-8b4e-34f782449bea {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:31 devstack sudo[99197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.7f0ae11e-eaaa-421f-8b4e-34f782449bea
Nov 05 15:13:31 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:31 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_iasi9xl7devstack@QuobyteHD" returned: 0 in 0.800s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:31 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Temporary image 21a5d804-2425-4adb-8e07-60d978b4be84 is fetched for user 05423723a9d14c8abb97f22387c6e2ab. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 15:13:31 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c4233a-461d-4e39-bd6f-1ff635c4bd4f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_iasi9xl7devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:32 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-42ea55f8-a3cd-46c0-b178-e1b6126ee974 tempest-TestStampPattern-527871853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.7f0ae11e-eaaa-421f-8b4e-34f782449bea" returned: 0 in 0.880s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-42ea55f8-a3cd-46c0-b178-e1b6126ee974 tempest-TestStampPattern-527871853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.7f0ae11e-eaaa-421f-8b4e-34f782449bea {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:32 devstack sudo[99209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_iasi9xl7devstack@QuobyteHD
Nov 05 15:13:32 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:32 devstack sudo[99211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.7f0ae11e-eaaa-421f-8b4e-34f782449bea
Nov 05 15:13:32 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:32 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_iasi9xl7devstack@QuobyteHD" returned: 0 in 0.799s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:32 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-42ea55f8-a3cd-46c0-b178-e1b6126ee974 tempest-TestStampPattern-527871853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768.7f0ae11e-eaaa-421f-8b4e-34f782449bea" returned: 0 in 0.629s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-42ea55f8-a3cd-46c0-b178-e1b6126ee974 tempest-TestStampPattern-527871853 None] Lock "cinder-quobyte-7f0ae11e-eaaa-421f-8b4e-34f782449bea" released by "_delete_snapshot" :: held 3.686s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-42ea55f8-a3cd-46c0-b178-e1b6126ee974 tempest-TestStampPattern-527871853 None] Lock "cinder-quobyte-c477a72e-838b-4440-b234-e27ce72c9768" released by "delete_snapshot" :: held 3.775s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:32 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-42ea55f8-a3cd-46c0-b178-e1b6126ee974 tempest-TestStampPattern-527871853 None] Created reservations ['fb18c57e-42bf-4d01-9d19-1f5f9d4def27', '9023a591-dce4-41ee-b996-3c303d3992cc', 'c18a99c9-49db-4289-a65b-2716b6e1f856', '2a343739-3487-4428-a377-ed7f374a20dc'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:13:33 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-42ea55f8-a3cd-46c0-b178-e1b6126ee974 tempest-TestStampPattern-527871853 None] Delete snapshot completed successfully.
Nov 05 15:13:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-42ea55f8-a3cd-46c0-b178-e1b6126ee974 tempest-TestStampPattern-527871853 None] Lock "cinder-7f0ae11e-eaaa-421f-8b4e-34f782449bea-delete_snapshot" released by "delete_snapshot" :: held 4.107s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:34 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06dbb477-5708-4e93-bd2c-0e96792f11b0" returned: 0 in 9.900s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:34 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Image conversion details: src /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f, size 1024.00 MB, duration 9.90 sec, destination /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06dbb477-5708-4e93-bd2c-0e96792f11b0 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:13:34 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Converted 1024.00 MB image at 103.42 MB/s
Nov 05 15:13:34 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06dbb477-5708-4e93-bd2c-0e96792f11b0 is being set with open permissions: ugo+rw
Nov 05 15:13:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06dbb477-5708-4e93-bd2c-0e96792f11b0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:34 devstack sudo[99222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06dbb477-5708-4e93-bd2c-0e96792f11b0
Nov 05 15:13:34 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:35 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06dbb477-5708-4e93-bd2c-0e96792f11b0" returned: 0 in 0.289s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-06dbb477-5708-4e93-bd2c-0e96792f11b0" released by "_copy_volume_from_snapshot" :: held 11.476s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-c7332fd0-5cf7-4d39-b764-c580dcf69319-06dbb477-5708-4e93-bd2c-0e96792f11b0" released by "_create_volume_from_snapshot" :: held 11.577s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.605s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.675s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1925675041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b36638d8-138c-4729-8ee7-869f4d1c33eb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0d2c00ed0df04d6889a72fafaf210c83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:13:29Z,use_quota=True,user_id='05423723a9d14c8abb97f22387c6e2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:13:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Creating volume b36638d8-138c-4729-8ee7-869f4d1c33eb {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:13:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:13:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:13:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:13:35 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:13:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b36638d8-138c-4729-8ee7-869f4d1c33eb 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:35 devstack sudo[99226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b36638d8-138c-4729-8ee7-869f4d1c33eb 1073741824
Nov 05 15:13:35 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827901b3-6289-43ec-8497-18863892c810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06dbb477-5708-4e93-bd2c-0e96792f11b0', 'volume_size': 1, 'snapshot_id': 'c7332fd0-5cf7-4d39-b764-c580dcf69319'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6850492d-ef72-49c6-97c0-1640a27ee8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:35 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Volume volume-06dbb477-5708-4e93-bd2c-0e96792f11b0 (06dbb477-5708-4e93-bd2c-0e96792f11b0): created successfully
Nov 05 15:13:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6850492d-ef72-49c6-97c0-1640a27ee8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Flow 'volume_create_manager' (122e127c-16d5-48c7-93e1-9d0ff0f3f9a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:13:35 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-21899ab4-92fa-4b73-a074-b1a51fa70259 tempest-VolumesSnapshotTestJSON-1973636354 None] Created volume successfully.
Nov 05 15:13:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2f25eeae-758f-4080-a0f2-36e072f3656b tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "cinder-06dbb477-5708-4e93-bd2c-0e96792f11b0-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2f25eeae-758f-4080-a0f2-36e072f3656b tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-06dbb477-5708-4e93-bd2c-0e96792f11b0-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2f25eeae-758f-4080-a0f2-36e072f3656b tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "cinder-quobyte-06dbb477-5708-4e93-bd2c-0e96792f11b0" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2f25eeae-758f-4080-a0f2-36e072f3656b tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-06dbb477-5708-4e93-bd2c-0e96792f11b0" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:36 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a161d460-d4d8-4f84-a508-9186e85a04ff]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2f25eeae-758f-4080-a0f2-36e072f3656b tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06dbb477-5708-4e93-bd2c-0e96792f11b0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:36 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b36638d8-138c-4729-8ee7-869f4d1c33eb 1073741824" returned: 0 in 0.961s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:36 devstack sudo[99255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06dbb477-5708-4e93-bd2c-0e96792f11b0
Nov 05 15:13:36 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b36638d8-138c-4729-8ee7-869f4d1c33eb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:36 devstack sudo[99259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b36638d8-138c-4729-8ee7-869f4d1c33eb
Nov 05 15:13:36 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:36 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b36638d8-138c-4729-8ee7-869f4d1c33eb" returned: 0 in 0.466s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:13:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:36 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2f25eeae-758f-4080-a0f2-36e072f3656b tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06dbb477-5708-4e93-bd2c-0e96792f11b0" returned: 0 in 0.678s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2f25eeae-758f-4080-a0f2-36e072f3656b tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06dbb477-5708-4e93-bd2c-0e96792f11b0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:36 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Attempting download of 21a5d804-2425-4adb-8e07-60d978b4be84 ((None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}])) to volume b36638d8-138c-4729-8ee7-869f4d1c33eb. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 15:13:36 devstack sudo[99278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06dbb477-5708-4e93-bd2c-0e96792f11b0
Nov 05 15:13:36 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:36 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05dd66f-a804-4ac3-9bb7-8b86a2f09318]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_xbmyxp8k {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:37 devstack sudo[99280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_xbmyxp8k
Nov 05 15:13:37 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:37 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2f25eeae-758f-4080-a0f2-36e072f3656b tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-06dbb477-5708-4e93-bd2c-0e96792f11b0" returned: 0 in 0.547s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:13:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:13:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:13:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:37 devstack sudo[99285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:13:37 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2f25eeae-758f-4080-a0f2-36e072f3656b tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-06dbb477-5708-4e93-bd2c-0e96792f11b0" released by "delete_volume" :: held 1.338s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:37 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-2f25eeae-758f-4080-a0f2-36e072f3656b tempest-VolumesSnapshotTestJSON-1973636354 None] Created reservations ['5961b14c-4f19-4d88-bdc6-deb5710160aa', '243202cb-6640-495c-a65a-5963ab9d9653', '7a9d764d-1e79-4003-b998-ef235df53cb7', '5d796f7a-4d96-48a1-bd39-cd00d36f10fe'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:13:37 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_xbmyxp8k" returned: 0 in 0.637s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_xbmyxp8k {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2f25eeae-758f-4080-a0f2-36e072f3656b tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2f25eeae-758f-4080-a0f2-36e072f3656b tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2f25eeae-758f-4080-a0f2-36e072f3656b tempest-VolumesSnapshotTestJSON-1973636354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:13:37 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2f25eeae-758f-4080-a0f2-36e072f3656b tempest-VolumesSnapshotTestJSON-1973636354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:13:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2f25eeae-758f-4080-a0f2-36e072f3656b tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2f25eeae-758f-4080-a0f2-36e072f3656b tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.404s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:13:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:13:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 15:13:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread info: [<_MainThread(MainThread, started 136317437956224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136317326340928)>, <Thread(Thread-3 (stat_writer), started daemon 136317326487936)>, <Thread(Rabbit-heartbeat, started daemon 136317321464000)>, <Thread(Thread-5 (_runner), started daemon 136317321550592)>, <Thread(Thread-7 (_runner), started daemon 136317321658496)>, <Thread(fd_logger, started daemon 136317319612992)>, <Thread(privsep_reader, started daemon 136317319622400)>, <Thread(tpool_thread_0, started daemon 136317310928576)>, <Thread(tpool_thread_1, started daemon 136317302535872)>, <Thread(tpool_thread_2, started daemon 136317294143168)>, <Thread(tpool_thread_3, started daemon 136317285750464)>, <Thread(tpool_thread_4, started daemon 136317277357760)>, <Thread(tpool_thread_5, started daemon 136317268965056)>, <Thread(tpool_thread_6, started daemon 136317260572352)>, <Thread(tpool_thread_7, started daemon 136317252179648)>, <Thread(tpool_thread_8, started daemon 136317243786944)>, <Thread(tpool_thread_9, started daemon 136317235394240)>, <Thread(tpool_thread_10, started daemon 136317227001536)>, <Thread(tpool_thread_11, started daemon 136317218608832)>, <Thread(tpool_thread_12, started daemon 136317210216128)>, <Thread(tpool_thread_13, started daemon 136317201807040)>, <Thread(tpool_thread_14, started daemon 136317193397952)>, <Thread(tpool_thread_15, started daemon 136317184988864)>, <Thread(tpool_thread_16, started daemon 136317176579776)>, <Thread(tpool_thread_17, started daemon 136317168170688)>, <Thread(tpool_thread_18, started daemon 136317159761600)>, <Thread(tpool_thread_19, started daemon 136317151352512)>] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 15:13:37 devstack sudo[99291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:13:37 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:37 devstack sudo[99289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_xbmyxp8k
Nov 05 15:13:37 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:38 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2f25eeae-758f-4080-a0f2-36e072f3656b tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.407s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-2f25eeae-758f-4080-a0f2-36e072f3656b tempest-VolumesSnapshotTestJSON-1973636354 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:13:38 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2f25eeae-758f-4080-a0f2-36e072f3656b tempest-VolumesSnapshotTestJSON-1973636354 None] Deleted volume successfully.
Nov 05 15:13:38 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_xbmyxp8k" returned: 1 in 0.659s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_xbmyxp8k' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2a5532-eea1-4691-b3b7-7fcd67cec52c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_iasi9xl7devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2f25eeae-758f-4080-a0f2-36e072f3656b tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-06dbb477-5708-4e93-bd2c-0e96792f11b0-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:38 devstack sudo[99297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_iasi9xl7devstack@QuobyteHD
Nov 05 15:13:38 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f4dad9c8-459f-446d-9fee-1a5b7f392229 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "cinder-c7332fd0-5cf7-4d39-b764-c580dcf69319-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f4dad9c8-459f-446d-9fee-1a5b7f392229 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-c7332fd0-5cf7-4d39-b764-c580dcf69319-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f4dad9c8-459f-446d-9fee-1a5b7f392229 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "cinder-quobyte-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f4dad9c8-459f-446d-9fee-1a5b7f392229 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f4dad9c8-459f-446d-9fee-1a5b7f392229 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "cinder-quobyte-c7332fd0-5cf7-4d39-b764-c580dcf69319" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f4dad9c8-459f-446d-9fee-1a5b7f392229 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-c7332fd0-5cf7-4d39-b764-c580dcf69319" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-f4dad9c8-459f-446d-9fee-1a5b7f392229 tempest-VolumesSnapshotTestJSON-1973636354 None] Deleting offline snapshot c7332fd0-5cf7-4d39-b764-c580dcf69319 of volume a7d1f53b-99cd-45db-ab16-605fb0ad8d3f {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-f4dad9c8-459f-446d-9fee-1a5b7f392229 tempest-VolumesSnapshotTestJSON-1973636354 None] snapshot_file for this snap is: volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.c7332fd0-5cf7-4d39-b764-c580dcf69319 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c384746b-cafa-44c7-ac6f-a46880c5da7b tempest-TestStampPattern-527871853 None] Acquiring lock "cinder-c477a72e-838b-4440-b234-e27ce72c9768-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[56556f2f-3ad1-44ba-b311-d478d6906f7a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f4dad9c8-459f-446d-9fee-1a5b7f392229 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.c7332fd0-5cf7-4d39-b764-c580dcf69319 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c384746b-cafa-44c7-ac6f-a46880c5da7b tempest-TestStampPattern-527871853 None] Lock "cinder-c477a72e-838b-4440-b234-e27ce72c9768-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c384746b-cafa-44c7-ac6f-a46880c5da7b tempest-TestStampPattern-527871853 None] Acquiring lock "cinder-quobyte-c477a72e-838b-4440-b234-e27ce72c9768" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c384746b-cafa-44c7-ac6f-a46880c5da7b tempest-TestStampPattern-527871853 None] Lock "cinder-quobyte-c477a72e-838b-4440-b234-e27ce72c9768" acquired by "delete_volume" :: waited 0.032s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:38 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_iasi9xl7devstack@QuobyteHD" returned: 0 in 0.517s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] 21a5d804-2425-4adb-8e07-60d978b4be84 was qcow2, converting to qcow2 {{(pid=87150) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_iasi9xl7devstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b36638d8-138c-4729-8ee7-869f4d1c33eb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:38 devstack sudo[99300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.c7332fd0-5cf7-4d39-b764-c580dcf69319
Nov 05 15:13:38 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08142ec-cc1b-473b-b883-465fbcbf2975]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c384746b-cafa-44c7-ac6f-a46880c5da7b tempest-TestStampPattern-527871853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:38 devstack sudo[99306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_iasi9xl7devstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b36638d8-138c-4729-8ee7-869f4d1c33eb
Nov 05 15:13:38 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:38 devstack sudo[99307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768
Nov 05 15:13:38 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f4dad9c8-459f-446d-9fee-1a5b7f392229 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.c7332fd0-5cf7-4d39-b764-c580dcf69319" returned: 0 in 0.521s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:39 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-f4dad9c8-459f-446d-9fee-1a5b7f392229 tempest-VolumesSnapshotTestJSON-1973636354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:13:39 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dee53a-9639-4b87-b22d-741aff9bf7d3]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f4dad9c8-459f-446d-9fee-1a5b7f392229 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:39 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c384746b-cafa-44c7-ac6f-a46880c5da7b tempest-TestStampPattern-527871853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768" returned: 0 in 0.487s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c384746b-cafa-44c7-ac6f-a46880c5da7b tempest-TestStampPattern-527871853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:39 devstack sudo[99320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f
Nov 05 15:13:39 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:39 devstack sudo[99322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768
Nov 05 15:13:39 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:39 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c384746b-cafa-44c7-ac6f-a46880c5da7b tempest-TestStampPattern-527871853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c477a72e-838b-4440-b234-e27ce72c9768" returned: 0 in 0.333s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c384746b-cafa-44c7-ac6f-a46880c5da7b tempest-TestStampPattern-527871853 None] Lock "cinder-quobyte-c477a72e-838b-4440-b234-e27ce72c9768" released by "delete_volume" :: held 0.923s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:39 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-c384746b-cafa-44c7-ac6f-a46880c5da7b tempest-TestStampPattern-527871853 None] Created reservations ['13c948e2-d86e-4287-86f7-c21cf18a68f0', 'e24f6cdc-df95-4876-8c0f-239be9b17de1', 'af9f0e35-4623-4797-959e-bd67cf6cfadb', '9ac4f3a7-e53a-43a1-b529-42707136d9a9'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:13:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c384746b-cafa-44c7-ac6f-a46880c5da7b tempest-TestStampPattern-527871853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c384746b-cafa-44c7-ac6f-a46880c5da7b tempest-TestStampPattern-527871853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c384746b-cafa-44c7-ac6f-a46880c5da7b tempest-TestStampPattern-527871853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:13:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c384746b-cafa-44c7-ac6f-a46880c5da7b tempest-TestStampPattern-527871853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:13:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c384746b-cafa-44c7-ac6f-a46880c5da7b tempest-TestStampPattern-527871853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c384746b-cafa-44c7-ac6f-a46880c5da7b tempest-TestStampPattern-527871853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:39 devstack sudo[99331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:13:39 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:39 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f4dad9c8-459f-446d-9fee-1a5b7f392229 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f" returned: 0 in 0.727s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f4dad9c8-459f-446d-9fee-1a5b7f392229 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.c7332fd0-5cf7-4d39-b764-c580dcf69319 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:39 devstack sudo[99333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.c7332fd0-5cf7-4d39-b764-c580dcf69319
Nov 05 15:13:39 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:40 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c384746b-cafa-44c7-ac6f-a46880c5da7b tempest-TestStampPattern-527871853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.316s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:40 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-c384746b-cafa-44c7-ac6f-a46880c5da7b tempest-TestStampPattern-527871853 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:13:40 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c384746b-cafa-44c7-ac6f-a46880c5da7b tempest-TestStampPattern-527871853 None] Deleted volume successfully.
Nov 05 15:13:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c384746b-cafa-44c7-ac6f-a46880c5da7b tempest-TestStampPattern-527871853 None] Lock "cinder-c477a72e-838b-4440-b234-e27ce72c9768-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:40 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f4dad9c8-459f-446d-9fee-1a5b7f392229 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.c7332fd0-5cf7-4d39-b764-c580dcf69319" returned: 0 in 0.462s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f4dad9c8-459f-446d-9fee-1a5b7f392229 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.c7332fd0-5cf7-4d39-b764-c580dcf69319 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:40 devstack sudo[99339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.c7332fd0-5cf7-4d39-b764-c580dcf69319
Nov 05 15:13:40 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:40 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f4dad9c8-459f-446d-9fee-1a5b7f392229 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f.c7332fd0-5cf7-4d39-b764-c580dcf69319" returned: 0 in 0.402s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f4dad9c8-459f-446d-9fee-1a5b7f392229 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-c7332fd0-5cf7-4d39-b764-c580dcf69319" released by "_delete_snapshot" :: held 2.335s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f4dad9c8-459f-446d-9fee-1a5b7f392229 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f" released by "delete_snapshot" :: held 2.393s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:41 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-f4dad9c8-459f-446d-9fee-1a5b7f392229 tempest-VolumesSnapshotTestJSON-1973636354 None] Created reservations ['83e012ee-a723-46a4-a2c8-debfa388be37', '527ab4de-5855-4140-9b6f-5aa89b94350f', 'feefd67b-38f0-484b-af91-0c97a8686424', '50358260-4cb5-4d27-848c-a92a2919aa6f'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:13:41 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f4dad9c8-459f-446d-9fee-1a5b7f392229 tempest-VolumesSnapshotTestJSON-1973636354 None] Delete snapshot completed successfully.
Nov 05 15:13:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f4dad9c8-459f-446d-9fee-1a5b7f392229 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-c7332fd0-5cf7-4d39-b764-c580dcf69319-delete_snapshot" released by "delete_snapshot" :: held 2.816s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:41 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_iasi9xl7devstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b36638d8-138c-4729-8ee7-869f4d1c33eb" returned: 0 in 3.159s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:41 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_iasi9xl7devstack@QuobyteHD, size 112.00 MB, duration 3.16 sec, destination /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b36638d8-138c-4729-8ee7-869f4d1c33eb {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:13:41 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Converted 112.00 MB image at 35.44 MB/s
Nov 05 15:13:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b36638d8-138c-4729-8ee7-869f4d1c33eb 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:41 devstack sudo[99408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b36638d8-138c-4729-8ee7-869f4d1c33eb 1G
Nov 05 15:13:41 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-835a58fb-df22-4df2-acf2-f16851b891c3 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "cinder-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-835a58fb-df22-4df2-acf2-f16851b891c3 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-835a58fb-df22-4df2-acf2-f16851b891c3 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "cinder-quobyte-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-835a58fb-df22-4df2-acf2-f16851b891c3 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f" acquired by "delete_volume" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:42 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73f77dd-f808-4064-837e-653b8d4d7235]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-835a58fb-df22-4df2-acf2-f16851b891c3 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:42 devstack sudo[99412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f
Nov 05 15:13:42 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:42 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b36638d8-138c-4729-8ee7-869f4d1c33eb 1G" returned: 0 in 0.724s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:42 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Downloaded image 21a5d804-2425-4adb-8e07-60d978b4be84 ((None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}])) to volume b36638d8-138c-4729-8ee7-869f4d1c33eb successfully. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 15:13:42 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Temporary image 21a5d804-2425-4adb-8e07-60d978b4be84 for user 05423723a9d14c8abb97f22387c6e2ab is deleted. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 15:13:42 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Marking volume b36638d8-138c-4729-8ee7-869f4d1c33eb as bootable. {{(pid=87150) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 15:13:42 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Copying metadata from image 21a5d804-2425-4adb-8e07-60d978b4be84 to b36638d8-138c-4729-8ee7-869f4d1c33eb. {{(pid=87150) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 15:13:42 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Creating volume glance metadata for volume b36638d8-138c-4729-8ee7-869f4d1c33eb backed by image 21a5d804-2425-4adb-8e07-60d978b4be84 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87150) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 15:13:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac23a144-67d5-4f2e-b35d-29da504ac22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b36638d8-138c-4729-8ee7-869f4d1c33eb', 'volume_size': 1, 'image_id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4a6a2406cd83415e894eebbb1d6b51ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'created_at': datetime.datetime(2026, 11, 5, 13, 57, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21a5d804-2425-4adb-8e07-60d978b4be84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfad93359d0>}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d9ff30-c2e6-4cf3-9ece-d05dce6d6dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:42 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Volume volume-b36638d8-138c-4729-8ee7-869f4d1c33eb (b36638d8-138c-4729-8ee7-869f4d1c33eb): created successfully
Nov 05 15:13:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d9ff30-c2e6-4cf3-9ece-d05dce6d6dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Flow 'volume_create_manager' (f4fe5441-bb40-4c28-b5b0-5dcfeb80dd63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:13:42 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4f9080da-63ee-4049-918f-92f826eb3d8d tempest-VolumesGetTest-1228684426 None] Created volume successfully.
Nov 05 15:13:43 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-835a58fb-df22-4df2-acf2-f16851b891c3 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f" returned: 0 in 0.886s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-835a58fb-df22-4df2-acf2-f16851b891c3 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:43 devstack sudo[99423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f
Nov 05 15:13:43 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:43 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-835a58fb-df22-4df2-acf2-f16851b891c3 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f" returned: 0 in 0.320s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-835a58fb-df22-4df2-acf2-f16851b891c3 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f" released by "delete_volume" :: held 1.316s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:43 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-835a58fb-df22-4df2-acf2-f16851b891c3 tempest-VolumesSnapshotTestJSON-1973636354 None] Created reservations ['14ffe4f0-04b8-4603-96fb-1905955f21e9', 'd66c1ea2-4f5e-4a98-9b8a-9c1472ac446d', '409ce729-b61a-4c62-b360-d2753e50cd03', '4394cd07-abf2-49ca-b619-6e652c955cf3'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:13:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-835a58fb-df22-4df2-acf2-f16851b891c3 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-835a58fb-df22-4df2-acf2-f16851b891c3 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-835a58fb-df22-4df2-acf2-f16851b891c3 tempest-VolumesSnapshotTestJSON-1973636354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:13:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-835a58fb-df22-4df2-acf2-f16851b891c3 tempest-VolumesSnapshotTestJSON-1973636354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:13:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-835a58fb-df22-4df2-acf2-f16851b891c3 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-835a58fb-df22-4df2-acf2-f16851b891c3 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:43 devstack sudo[99426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:13:43 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:44 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-835a58fb-df22-4df2-acf2-f16851b891c3 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.343s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-835a58fb-df22-4df2-acf2-f16851b891c3 tempest-VolumesSnapshotTestJSON-1973636354 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:13:44 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-835a58fb-df22-4df2-acf2-f16851b891c3 tempest-VolumesSnapshotTestJSON-1973636354 None] Deleted volume successfully.
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-835a58fb-df22-4df2-acf2-f16851b891c3 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-a7d1f53b-99cd-45db-ab16-605fb0ad8d3f-delete_volume" released by "delete_volume" :: held 2.043s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-026f82b2-7b66-4b76-bb61-ad2e5a95c156 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "cinder-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-026f82b2-7b66-4b76-bb61-ad2e5a95c156 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Flow 'volume_create_manager' (1b778acb-fc6c-4dcd-9a98-66380b8914a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (463ab692-bb9f-4eda-82fe-2f9a2af07810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-026f82b2-7b66-4b76-bb61-ad2e5a95c156 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "cinder-quobyte-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (463ab692-bb9f-4eda-82fe-2f9a2af07810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:13:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-241616998',display_name='tempest-VolumesGetTest-Volume-918951615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f26336-d53b-46ec-9f55-8c4a36d040d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2c00ed0df04d6889a72fafaf210c83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:13:45Z,use_quota=True,user_id='05423723a9d14c8abb97f22387c6e2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b35ef40-5ce4-416d-b221-34df80f74e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b35ef40-5ce4-416d-b221-34df80f74e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a51fe1c-fe93-4392-b3f2-2e90ad9a0689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a51fe1c-fe93-4392-b3f2-2e90ad9a0689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48f26336-d53b-46ec-9f55-8c4a36d040d8', 'volume_name': 'volume-48f26336-d53b-46ec-9f55-8c4a36d040d8', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ee3371a-8302-4ed2-89cb-6852f77ac0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ee3371a-8302-4ed2-89cb-6852f77ac0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b80da425-a006-4e84-b418-a54f15b0dfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:44 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Volume 48f26336-d53b-46ec-9f55-8c4a36d040d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48f26336-d53b-46ec-9f55-8c4a36d040d8', 'volume_size': 1}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:13:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-241616998',display_name='tempest-VolumesGetTest-Volume-918951615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f26336-d53b-46ec-9f55-8c4a36d040d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2c00ed0df04d6889a72fafaf210c83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:13:45Z,use_quota=True,user_id='05423723a9d14c8abb97f22387c6e2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Creating volume 48f26336-d53b-46ec-9f55-8c4a36d040d8 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:13:44 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-48f26336-d53b-46ec-9f55-8c4a36d040d8 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-026f82b2-7b66-4b76-bb61-ad2e5a95c156 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b" acquired by "delete_volume" :: waited 0.106s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:44 devstack sudo[99430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-48f26336-d53b-46ec-9f55-8c4a36d040d8 1073741824
Nov 05 15:13:44 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:45 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0081c1ce-9ec5-4f60-9ebb-134db5b4501e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-026f82b2-7b66-4b76-bb61-ad2e5a95c156 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:45 devstack sudo[99432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b
Nov 05 15:13:45 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:45 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-026f82b2-7b66-4b76-bb61-ad2e5a95c156 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b" returned: 0 in 0.731s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-026f82b2-7b66-4b76-bb61-ad2e5a95c156 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:45 devstack sudo[99441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b
Nov 05 15:13:45 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:45 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-48f26336-d53b-46ec-9f55-8c4a36d040d8 1073741824" returned: 0 in 0.976s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-48f26336-d53b-46ec-9f55-8c4a36d040d8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:46 devstack sudo[99444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-48f26336-d53b-46ec-9f55-8c4a36d040d8
Nov 05 15:13:46 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:46 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-026f82b2-7b66-4b76-bb61-ad2e5a95c156 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b" returned: 0 in 0.606s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-026f82b2-7b66-4b76-bb61-ad2e5a95c156 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-quobyte-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b" released by "delete_volume" :: held 1.477s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:46 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-48f26336-d53b-46ec-9f55-8c4a36d040d8" returned: 0 in 0.473s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:13:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b80da425-a006-4e84-b418-a54f15b0dfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48f26336-d53b-46ec-9f55-8c4a36d040d8', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7e8781-ce86-496f-90ab-a05c238c7c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:46 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Volume volume-48f26336-d53b-46ec-9f55-8c4a36d040d8 (48f26336-d53b-46ec-9f55-8c4a36d040d8): created successfully
Nov 05 15:13:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7e8781-ce86-496f-90ab-a05c238c7c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Flow 'volume_create_manager' (1b778acb-fc6c-4dcd-9a98-66380b8914a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:13:46 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-026f82b2-7b66-4b76-bb61-ad2e5a95c156 tempest-VolumesSnapshotTestJSON-1973636354 None] Created reservations ['22a14782-4960-460f-b1d5-27dae82ab084', '475c47e3-52d6-42e0-9cb1-c79eb39673fc', '1fea188f-7cd7-45cd-aedd-131e0e085dc2', '4c258b7c-c26a-44f5-ad34-b96581300eef'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:13:46 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f08bfa8b-18b3-41c4-b21e-8336b322c260 tempest-VolumesGetTest-1228684426 None] Created volume successfully.
Nov 05 15:13:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-026f82b2-7b66-4b76-bb61-ad2e5a95c156 tempest-VolumesSnapshotTestJSON-1973636354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-026f82b2-7b66-4b76-bb61-ad2e5a95c156 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-026f82b2-7b66-4b76-bb61-ad2e5a95c156 tempest-VolumesSnapshotTestJSON-1973636354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:13:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-026f82b2-7b66-4b76-bb61-ad2e5a95c156 tempest-VolumesSnapshotTestJSON-1973636354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:13:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-026f82b2-7b66-4b76-bb61-ad2e5a95c156 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-026f82b2-7b66-4b76-bb61-ad2e5a95c156 tempest-VolumesSnapshotTestJSON-1973636354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:46 devstack sudo[99448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:13:46 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:46 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-026f82b2-7b66-4b76-bb61-ad2e5a95c156 tempest-VolumesSnapshotTestJSON-1973636354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.280s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:46 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-026f82b2-7b66-4b76-bb61-ad2e5a95c156 tempest-VolumesSnapshotTestJSON-1973636354 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:13:46 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-026f82b2-7b66-4b76-bb61-ad2e5a95c156 tempest-VolumesSnapshotTestJSON-1973636354 None] Deleted volume successfully.
Nov 05 15:13:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-026f82b2-7b66-4b76-bb61-ad2e5a95c156 tempest-VolumesSnapshotTestJSON-1973636354 None] Lock "cinder-8e3997e7-711e-4e1f-8c1f-5e25e51fce6b-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7feb4547-6428-42fd-bad8-fc10f597e024 tempest-VolumesGetTest-1228684426 None] Acquiring lock "cinder-48f26336-d53b-46ec-9f55-8c4a36d040d8-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7feb4547-6428-42fd-bad8-fc10f597e024 tempest-VolumesGetTest-1228684426 None] Lock "cinder-48f26336-d53b-46ec-9f55-8c4a36d040d8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7feb4547-6428-42fd-bad8-fc10f597e024 tempest-VolumesGetTest-1228684426 None] Acquiring lock "cinder-quobyte-48f26336-d53b-46ec-9f55-8c4a36d040d8" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7feb4547-6428-42fd-bad8-fc10f597e024 tempest-VolumesGetTest-1228684426 None] Lock "cinder-quobyte-48f26336-d53b-46ec-9f55-8c4a36d040d8" acquired by "delete_volume" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:47 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba5283f-7992-45b0-8423-27adf684768d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7feb4547-6428-42fd-bad8-fc10f597e024 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-48f26336-d53b-46ec-9f55-8c4a36d040d8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:47 devstack sudo[99452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-48f26336-d53b-46ec-9f55-8c4a36d040d8
Nov 05 15:13:47 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:47 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7feb4547-6428-42fd-bad8-fc10f597e024 tempest-VolumesGetTest-1228684426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-48f26336-d53b-46ec-9f55-8c4a36d040d8" returned: 0 in 0.605s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7feb4547-6428-42fd-bad8-fc10f597e024 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-48f26336-d53b-46ec-9f55-8c4a36d040d8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:47 devstack sudo[99457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-48f26336-d53b-46ec-9f55-8c4a36d040d8
Nov 05 15:13:47 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:48 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7feb4547-6428-42fd-bad8-fc10f597e024 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-48f26336-d53b-46ec-9f55-8c4a36d040d8" returned: 0 in 0.330s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7feb4547-6428-42fd-bad8-fc10f597e024 tempest-VolumesGetTest-1228684426 None] Lock "cinder-quobyte-48f26336-d53b-46ec-9f55-8c4a36d040d8" released by "delete_volume" :: held 1.023s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:48 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-7feb4547-6428-42fd-bad8-fc10f597e024 tempest-VolumesGetTest-1228684426 None] Created reservations ['20ad1cf0-a125-4ae7-8708-5850433f47c1', '92d92c92-5ac0-4797-9c7e-9d8f57f7258d', '3bcb6567-25ec-4bfb-9017-afbff8603ce5', 'facdc877-133a-4614-a7ee-ef5e9fef5e9d'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:13:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7feb4547-6428-42fd-bad8-fc10f597e024 tempest-VolumesGetTest-1228684426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7feb4547-6428-42fd-bad8-fc10f597e024 tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7feb4547-6428-42fd-bad8-fc10f597e024 tempest-VolumesGetTest-1228684426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:13:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7feb4547-6428-42fd-bad8-fc10f597e024 tempest-VolumesGetTest-1228684426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:13:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7feb4547-6428-42fd-bad8-fc10f597e024 tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7feb4547-6428-42fd-bad8-fc10f597e024 tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:48 devstack sudo[99461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:13:48 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:48 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7feb4547-6428-42fd-bad8-fc10f597e024 tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.339s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:48 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-7feb4547-6428-42fd-bad8-fc10f597e024 tempest-VolumesGetTest-1228684426 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:13:48 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7feb4547-6428-42fd-bad8-fc10f597e024 tempest-VolumesGetTest-1228684426 None] Deleted volume successfully.
Nov 05 15:13:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7feb4547-6428-42fd-bad8-fc10f597e024 tempest-VolumesGetTest-1228684426 None] Lock "cinder-48f26336-d53b-46ec-9f55-8c4a36d040d8-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-35878e48-ca0e-4727-9c82-23d870432e4d tempest-VolumesGetTest-1228684426 None] Acquiring lock "cinder-b36638d8-138c-4729-8ee7-869f4d1c33eb-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-35878e48-ca0e-4727-9c82-23d870432e4d tempest-VolumesGetTest-1228684426 None] Lock "cinder-b36638d8-138c-4729-8ee7-869f4d1c33eb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-35878e48-ca0e-4727-9c82-23d870432e4d tempest-VolumesGetTest-1228684426 None] Acquiring lock "cinder-quobyte-b36638d8-138c-4729-8ee7-869f4d1c33eb" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:13:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-35878e48-ca0e-4727-9c82-23d870432e4d tempest-VolumesGetTest-1228684426 None] Lock "cinder-quobyte-b36638d8-138c-4729-8ee7-869f4d1c33eb" acquired by "delete_volume" :: waited 0.033s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:13:49 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbd3fbb-1f6f-4752-9dec-8c2ce4184333]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:13:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-35878e48-ca0e-4727-9c82-23d870432e4d tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b36638d8-138c-4729-8ee7-869f4d1c33eb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:49 devstack sudo[99467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b36638d8-138c-4729-8ee7-869f4d1c33eb
Nov 05 15:13:49 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:50 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-35878e48-ca0e-4727-9c82-23d870432e4d tempest-VolumesGetTest-1228684426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b36638d8-138c-4729-8ee7-869f4d1c33eb" returned: 0 in 0.520s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-35878e48-ca0e-4727-9c82-23d870432e4d tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b36638d8-138c-4729-8ee7-869f4d1c33eb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:50 devstack sudo[99472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b36638d8-138c-4729-8ee7-869f4d1c33eb
Nov 05 15:13:50 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:50 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-35878e48-ca0e-4727-9c82-23d870432e4d tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b36638d8-138c-4729-8ee7-869f4d1c33eb" returned: 0 in 0.290s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-35878e48-ca0e-4727-9c82-23d870432e4d tempest-VolumesGetTest-1228684426 None] Lock "cinder-quobyte-b36638d8-138c-4729-8ee7-869f4d1c33eb" released by "delete_volume" :: held 0.894s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:50 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-35878e48-ca0e-4727-9c82-23d870432e4d tempest-VolumesGetTest-1228684426 None] Created reservations ['ee313c12-257e-438c-abda-c2d44be48009', 'd1fb4db1-41bf-4ffe-9a76-019c1cf419da', '1070b6de-b008-4701-9e6d-41fd15403776', '1de56031-d265-4c4d-a73c-bf1641dcb7c5'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:13:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-35878e48-ca0e-4727-9c82-23d870432e4d tempest-VolumesGetTest-1228684426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-35878e48-ca0e-4727-9c82-23d870432e4d tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-35878e48-ca0e-4727-9c82-23d870432e4d tempest-VolumesGetTest-1228684426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:13:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-35878e48-ca0e-4727-9c82-23d870432e4d tempest-VolumesGetTest-1228684426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:13:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-35878e48-ca0e-4727-9c82-23d870432e4d tempest-VolumesGetTest-1228684426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-35878e48-ca0e-4727-9c82-23d870432e4d tempest-VolumesGetTest-1228684426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:50 devstack sudo[99476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:13:50 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:51 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-35878e48-ca0e-4727-9c82-23d870432e4d tempest-VolumesGetTest-1228684426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.595s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:51 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-35878e48-ca0e-4727-9c82-23d870432e4d tempest-VolumesGetTest-1228684426 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:13:51 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-35878e48-ca0e-4727-9c82-23d870432e4d tempest-VolumesGetTest-1228684426 None] Deleted volume successfully.
Nov 05 15:13:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-35878e48-ca0e-4727-9c82-23d870432e4d tempest-VolumesGetTest-1228684426 None] Lock "cinder-b36638d8-138c-4729-8ee7-869f4d1c33eb-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:13:58 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:13:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Flow 'volume_create_manager' (90da0f0f-dac5-42c8-8566-5fb75dc00bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:13:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07448722-e90b-42c6-9c55-5837daea5ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07448722-e90b-42c6-9c55-5837daea5ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1624202452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71550ac3-f1ce-4b5f-87b5-24ecd36cc079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14788edec5fb4cf1b587e53d55975fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:13:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:13:59Z,use_quota=True,user_id='c37ebc1ed54f49d8ad32b1dc04be1181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f335720-cc53-4347-b7ea-633c08451a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f335720-cc53-4347-b7ea-633c08451a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (917c8d5a-04f2-4ae8-bf03-dab03e8fb06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (917c8d5a-04f2-4ae8-bf03-dab03e8fb06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71550ac3-f1ce-4b5f-87b5-24ecd36cc079', 'volume_name': 'volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079', 'volume_size': 2}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6863d296-6f94-4334-8ac9-4421868f75b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6863d296-6f94-4334-8ac9-4421868f75b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec42a732-a114-40b1-b550-dcaf64e8edb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:58 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Volume 71550ac3-f1ce-4b5f-87b5-24ecd36cc079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079', 'volume_size': 2}
Nov 05 15:13:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1624202452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71550ac3-f1ce-4b5f-87b5-24ecd36cc079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14788edec5fb4cf1b587e53d55975fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:13:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:13:59Z,use_quota=True,user_id='c37ebc1ed54f49d8ad32b1dc04be1181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:13:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Creating volume 71550ac3-f1ce-4b5f-87b5-24ecd36cc079 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:13:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:13:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:13:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:13:58 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:13:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079 2147483648 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:58 devstack sudo[99500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079 2147483648
Nov 05 15:13:58 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Flow 'volume_create_manager' (82056a7c-940d-4eac-99e3-b7d82f72383a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a30c7cb-8323-47fe-8341-3fb7c4ff2a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a30c7cb-8323-47fe-8341-3fb7c4ff2a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1777769207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f115c8be-cc06-453f-9db6-a0988bf97661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd51ffb4079a465785d427cba5372103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:13:59Z,use_quota=True,user_id='ff6e2b4ea48b4a88b573a49614cac819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23656282-9dd3-4676-bd17-6d85a2678dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23656282-9dd3-4676-bd17-6d85a2678dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5a8e54-ed5d-4cbd-88f4-ade687ce451c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5a8e54-ed5d-4cbd-88f4-ade687ce451c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f115c8be-cc06-453f-9db6-a0988bf97661', 'volume_name': 'volume-f115c8be-cc06-453f-9db6-a0988bf97661', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427fe6fb-9f67-48bc-98c2-56f4e6a3bcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427fe6fb-9f67-48bc-98c2-56f4e6a3bcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72642329-81b5-46a5-af95-70679b5c5056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:59 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Volume f115c8be-cc06-453f-9db6-a0988bf97661: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f115c8be-cc06-453f-9db6-a0988bf97661', 'volume_size': 1}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:59 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079 2147483648" returned: 0 in 0.576s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:13:59 devstack sudo[99507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079
Nov 05 15:13:59 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Flow 'volume_create_manager' (d2ebdf62-cf9a-4660-b3bf-73cff0f5f228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb82689-d337-4622-bfdb-025e68472179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb82689-d337-4622-bfdb-025e68472179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf23da7d-c6c3-45f1-97d3-da2346975968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e89af4d0333b4bceb7015952059bbf82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:13:59Z,use_quota=True,user_id='10bfb677729a44a0ba4b5ecb37bcc8e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314869db-477d-469b-acf2-73a2aeb684eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314869db-477d-469b-acf2-73a2aeb684eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc8a9e5-019c-49ed-ab16-f6b86b5727ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc8a9e5-019c-49ed-ab16-f6b86b5727ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf23da7d-c6c3-45f1-97d3-da2346975968', 'volume_name': 'volume-cf23da7d-c6c3-45f1-97d3-da2346975968', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5bc7ad3-02d4-4473-a6ab-9af00992a37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5bc7ad3-02d4-4473-a6ab-9af00992a37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5a1d72-e670-4f36-a4c8-336d8eac4c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:59 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Volume cf23da7d-c6c3-45f1-97d3-da2346975968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf23da7d-c6c3-45f1-97d3-da2346975968', 'volume_size': 1}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:59 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079" returned: 0 in 0.258s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.410s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1777769207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f115c8be-cc06-453f-9db6-a0988bf97661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd51ffb4079a465785d427cba5372103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:13:59Z,use_quota=True,user_id='ff6e2b4ea48b4a88b573a49614cac819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Creating volume f115c8be-cc06-453f-9db6-a0988bf97661 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:13:59 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:13:59 devstack sudo[99510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661 1073741824
Nov 05 15:13:59 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec42a732-a114-40b1-b550-dcaf64e8edb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079', 'volume_size': 2}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1296ee22-ecf9-40f2-999e-31e03621dffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:13:59 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Volume volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079 (71550ac3-f1ce-4b5f-87b5-24ecd36cc079): created successfully
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1296ee22-ecf9-40f2-999e-31e03621dffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Flow 'volume_create_manager' (90da0f0f-dac5-42c8-8566-5fb75dc00bc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:13:59 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3a540c1d-8e2b-4c53-a120-91c2e9f91ced tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Created volume successfully.
Nov 05 15:14:00 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661 1073741824" returned: 0 in 0.416s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:00 devstack sudo[99516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661
Nov 05 15:14:00 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:00 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661" returned: 0 in 0.241s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:14:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.842s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf23da7d-c6c3-45f1-97d3-da2346975968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e89af4d0333b4bceb7015952059bbf82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:13:59Z,use_quota=True,user_id='10bfb677729a44a0ba4b5ecb37bcc8e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:14:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Creating volume cf23da7d-c6c3-45f1-97d3-da2346975968 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:14:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:14:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:14:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:14:00 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:14:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cf23da7d-c6c3-45f1-97d3-da2346975968 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72642329-81b5-46a5-af95-70679b5c5056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f115c8be-cc06-453f-9db6-a0988bf97661', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:00 devstack sudo[99519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cf23da7d-c6c3-45f1-97d3-da2346975968 1073741824
Nov 05 15:14:00 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207beb99-36f7-4b48-85ea-e4f23ae3405a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:00 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Volume volume-f115c8be-cc06-453f-9db6-a0988bf97661 (f115c8be-cc06-453f-9db6-a0988bf97661): created successfully
Nov 05 15:14:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207beb99-36f7-4b48-85ea-e4f23ae3405a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Flow 'volume_create_manager' (82056a7c-940d-4eac-99e3-b7d82f72383a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:14:00 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-17516d60-1331-42cd-baa2-0094f7899829 tempest-VolumesSnapshotListTestJSON-1670634772 None] Created volume successfully.
Nov 05 15:14:00 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cf23da7d-c6c3-45f1-97d3-da2346975968 1073741824" returned: 0 in 0.443s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cf23da7d-c6c3-45f1-97d3-da2346975968 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05afcc35-8b54-4615-8405-74fea6736fc9 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:00 devstack sudo[99525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cf23da7d-c6c3-45f1-97d3-da2346975968
Nov 05 15:14:00 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:01 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cf23da7d-c6c3-45f1-97d3-da2346975968" returned: 0 in 0.263s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:14:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05afcc35-8b54-4615-8405-74fea6736fc9 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.254s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5a1d72-e670-4f36-a4c8-336d8eac4c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf23da7d-c6c3-45f1-97d3-da2346975968', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9824c8-b084-455c-b356-3ef66370e2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-05afcc35-8b54-4615-8405-74fea6736fc9 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Creating offline snapshot 2148401f-7aa8-43c6-8792-60829a4b843e of volume 71550ac3-f1ce-4b5f-87b5-24ecd36cc079 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:14:01 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Volume volume-cf23da7d-c6c3-45f1-97d3-da2346975968 (cf23da7d-c6c3-45f1-97d3-da2346975968): created successfully
Nov 05 15:14:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9824c8-b084-455c-b356-3ef66370e2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Flow 'volume_create_manager' (d2ebdf62-cf9a-4660-b3bf-73cff0f5f228) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:14:01 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8109e89e-d65d-4f99-9451-82b1797db708]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05afcc35-8b54-4615-8405-74fea6736fc9 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-aaf79abb-8032-4cb1-a357-83458abf708a tempest-CinderUnicodeTest-363760677 None] Created volume successfully.
Nov 05 15:14:01 devstack sudo[99528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079
Nov 05 15:14:01 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-29a3347b-904f-45bd-acfc-a2326feb2d54 tempest-VolumesSnapshotListTestJSON-1670634772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:01 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05afcc35-8b54-4615-8405-74fea6736fc9 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079" returned: 0 in 0.391s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05afcc35-8b54-4615-8405-74fea6736fc9 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.2148401f-7aa8-43c6-8792-60829a4b843e 2G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:01 devstack sudo[99533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.2148401f-7aa8-43c6-8792-60829a4b843e 2G
Nov 05 15:14:01 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:01 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:14:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Flow 'volume_create_manager' (2caadcc9-f210-4942-a1c2-081733731de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eea4a4a-c62e-46d3-9d5a-07890767f8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eea4a4a-c62e-46d3-9d5a-07890767f8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:14:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-317770200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46452794-4738-4a25-9399-bcd42700aa7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e89af4d0333b4bceb7015952059bbf82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:02Z,use_quota=True,user_id='10bfb677729a44a0ba4b5ecb37bcc8e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (298760aa-a50a-4cd3-a8c8-286f07238bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (298760aa-a50a-4cd3-a8c8-286f07238bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:02 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65cf6833-65fa-4587-8c0a-2b9853ac6c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65cf6833-65fa-4587-8c0a-2b9853ac6c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46452794-4738-4a25-9399-bcd42700aa7d', 'volume_name': 'volume-46452794-4738-4a25-9399-bcd42700aa7d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb4b2a5-7be0-4dcd-9597-9d34e2f2582f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb4b2a5-7be0-4dcd-9597-9d34e2f2582f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4210480f-fc64-4c21-931d-188bfb48201b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:02 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Volume 46452794-4738-4a25-9399-bcd42700aa7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46452794-4738-4a25-9399-bcd42700aa7d', 'volume_size': 1}
Nov 05 15:14:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05afcc35-8b54-4615-8405-74fea6736fc9 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.2148401f-7aa8-43c6-8792-60829a4b843e 2G" returned: 0 in 0.494s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05afcc35-8b54-4615-8405-74fea6736fc9 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.2148401f-7aa8-43c6-8792-60829a4b843e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:02 devstack sudo[99539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.2148401f-7aa8-43c6-8792-60829a4b843e
Nov 05 15:14:02 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:02 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05afcc35-8b54-4615-8405-74fea6736fc9 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.2148401f-7aa8-43c6-8792-60829a4b843e" returned: 0 in 0.302s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:02 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-05afcc35-8b54-4615-8405-74fea6736fc9 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.2148401f-7aa8-43c6-8792-60829a4b843e is being set with open permissions: ugo+rw
Nov 05 15:14:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05afcc35-8b54-4615-8405-74fea6736fc9 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.2148401f-7aa8-43c6-8792-60829a4b843e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:02 devstack sudo[99544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.2148401f-7aa8-43c6-8792-60829a4b843e
Nov 05 15:14:02 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:02 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05afcc35-8b54-4615-8405-74fea6736fc9 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.2148401f-7aa8-43c6-8792-60829a4b843e" returned: 0 in 0.238s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05afcc35-8b54-4615-8405-74fea6736fc9 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:02 devstack sudo[99547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.info
Nov 05 15:14:02 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:02 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05afcc35-8b54-4615-8405-74fea6736fc9 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.info" returned: 0 in 0.248s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:02 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-05afcc35-8b54-4615-8405-74fea6736fc9 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.info is being set with open permissions: ugo+rw
Nov 05 15:14:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05afcc35-8b54-4615-8405-74fea6736fc9 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:02 devstack sudo[99550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.info
Nov 05 15:14:02 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:03 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05afcc35-8b54-4615-8405-74fea6736fc9 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.info" returned: 0 in 0.238s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05afcc35-8b54-4615-8405-74fea6736fc9 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.024s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-29a3347b-904f-45bd-acfc-a2326feb2d54 tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.766s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-29a3347b-904f-45bd-acfc-a2326feb2d54 tempest-VolumesSnapshotListTestJSON-1670634772 None] Creating offline snapshot b0371068-8a5a-4dcd-a7fd-2f83ff091cb5 of volume f115c8be-cc06-453f-9db6-a0988bf97661 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:14:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-05afcc35-8b54-4615-8405-74fea6736fc9 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Create snapshot completed successfully
Nov 05 15:14:03 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e81c5f-b4fe-4e64-8d6c-85085235d6f8]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29a3347b-904f-45bd-acfc-a2326feb2d54 tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:03 devstack sudo[99553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661
Nov 05 15:14:03 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:03 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29a3347b-904f-45bd-acfc-a2326feb2d54 tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661" returned: 0 in 0.369s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29a3347b-904f-45bd-acfc-a2326feb2d54 tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:03 devstack sudo[99558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5 1G
Nov 05 15:14:03 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:04 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29a3347b-904f-45bd-acfc-a2326feb2d54 tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5 1G" returned: 0 in 0.480s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29a3347b-904f-45bd-acfc-a2326feb2d54 tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f115c8be-cc06-453f-9db6-a0988bf97661 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:04 devstack sudo[99567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f115c8be-cc06-453f-9db6-a0988bf97661 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5
Nov 05 15:14:04 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4f98fe9a-76d5-4e8f-8b2c-f2991898363a tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Acquiring lock "cinder-2148401f-7aa8-43c6-8792-60829a4b843e-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4f98fe9a-76d5-4e8f-8b2c-f2991898363a tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Lock "cinder-2148401f-7aa8-43c6-8792-60829a4b843e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4f98fe9a-76d5-4e8f-8b2c-f2991898363a tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Acquiring lock "cinder-quobyte-71550ac3-f1ce-4b5f-87b5-24ecd36cc079" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4f98fe9a-76d5-4e8f-8b2c-f2991898363a tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Lock "cinder-quobyte-71550ac3-f1ce-4b5f-87b5-24ecd36cc079" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4f98fe9a-76d5-4e8f-8b2c-f2991898363a tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Acquiring lock "cinder-quobyte-2148401f-7aa8-43c6-8792-60829a4b843e" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4f98fe9a-76d5-4e8f-8b2c-f2991898363a tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Lock "cinder-quobyte-2148401f-7aa8-43c6-8792-60829a4b843e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4f98fe9a-76d5-4e8f-8b2c-f2991898363a tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Deleting offline snapshot 2148401f-7aa8-43c6-8792-60829a4b843e of volume 71550ac3-f1ce-4b5f-87b5-24ecd36cc079 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:14:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4f98fe9a-76d5-4e8f-8b2c-f2991898363a tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] snapshot_file for this snap is: volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.2148401f-7aa8-43c6-8792-60829a4b843e {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:14:04 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41a5930-b977-41e5-b3f3-557f128f95d2]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f98fe9a-76d5-4e8f-8b2c-f2991898363a tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.2148401f-7aa8-43c6-8792-60829a4b843e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:04 devstack sudo[99569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.2148401f-7aa8-43c6-8792-60829a4b843e
Nov 05 15:14:04 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:04 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29a3347b-904f-45bd-acfc-a2326feb2d54 tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f115c8be-cc06-453f-9db6-a0988bf97661 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5" returned: 0 in 0.336s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:04 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-29a3347b-904f-45bd-acfc-a2326feb2d54 tempest-VolumesSnapshotListTestJSON-1670634772 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5 is being set with open permissions: ugo+rw
Nov 05 15:14:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29a3347b-904f-45bd-acfc-a2326feb2d54 tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:04 devstack sudo[99575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5
Nov 05 15:14:04 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:04 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f98fe9a-76d5-4e8f-8b2c-f2991898363a tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.2148401f-7aa8-43c6-8792-60829a4b843e" returned: 0 in 0.390s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4f98fe9a-76d5-4e8f-8b2c-f2991898363a tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:14:04 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29a3347b-904f-45bd-acfc-a2326feb2d54 tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5" returned: 0 in 0.272s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:04 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2b0eeb-bd25-41c5-af7a-9abf7b1b31a0]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f98fe9a-76d5-4e8f-8b2c-f2991898363a tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29a3347b-904f-45bd-acfc-a2326feb2d54 tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:04 devstack sudo[99582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.info
Nov 05 15:14:04 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:04 devstack sudo[99581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079
Nov 05 15:14:04 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:04 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29a3347b-904f-45bd-acfc-a2326feb2d54 tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.info" returned: 0 in 0.267s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:04 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-29a3347b-904f-45bd-acfc-a2326feb2d54 tempest-VolumesSnapshotListTestJSON-1670634772 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.info is being set with open permissions: ugo+rw
Nov 05 15:14:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29a3347b-904f-45bd-acfc-a2326feb2d54 tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:04 devstack sudo[99588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.info
Nov 05 15:14:04 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:05 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f98fe9a-76d5-4e8f-8b2c-f2991898363a tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079" returned: 0 in 0.389s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f98fe9a-76d5-4e8f-8b2c-f2991898363a tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.2148401f-7aa8-43c6-8792-60829a4b843e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:05 devstack sudo[99591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.2148401f-7aa8-43c6-8792-60829a4b843e
Nov 05 15:14:05 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:05 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29a3347b-904f-45bd-acfc-a2326feb2d54 tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.info" returned: 0 in 0.277s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-29a3347b-904f-45bd-acfc-a2326feb2d54 tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.108s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.193s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:14:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-317770200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46452794-4738-4a25-9399-bcd42700aa7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e89af4d0333b4bceb7015952059bbf82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:02Z,use_quota=True,user_id='10bfb677729a44a0ba4b5ecb37bcc8e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:14:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Creating volume 46452794-4738-4a25-9399-bcd42700aa7d {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:14:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:14:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:14:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:14:05 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:14:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:05 devstack sudo[99596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d 1073741824
Nov 05 15:14:05 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:05 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-29a3347b-904f-45bd-acfc-a2326feb2d54 tempest-VolumesSnapshotListTestJSON-1670634772 None] Create snapshot completed successfully
Nov 05 15:14:05 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f98fe9a-76d5-4e8f-8b2c-f2991898363a tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.2148401f-7aa8-43c6-8792-60829a4b843e" returned: 0 in 0.393s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f98fe9a-76d5-4e8f-8b2c-f2991898363a tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.2148401f-7aa8-43c6-8792-60829a4b843e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:05 devstack sudo[99599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.2148401f-7aa8-43c6-8792-60829a4b843e
Nov 05 15:14:05 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:05 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f98fe9a-76d5-4e8f-8b2c-f2991898363a tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079.2148401f-7aa8-43c6-8792-60829a4b843e" returned: 0 in 0.356s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e597d59e-7484-48a6-b619-97ebed87de5a tempest-VolumesSnapshotListTestJSON-1670634772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:05 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d 1073741824" returned: 0 in 0.579s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4f98fe9a-76d5-4e8f-8b2c-f2991898363a tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Lock "cinder-quobyte-2148401f-7aa8-43c6-8792-60829a4b843e" released by "_delete_snapshot" :: held 1.671s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4f98fe9a-76d5-4e8f-8b2c-f2991898363a tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Lock "cinder-quobyte-71550ac3-f1ce-4b5f-87b5-24ecd36cc079" released by "delete_snapshot" :: held 1.701s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:05 devstack sudo[99606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d
Nov 05 15:14:05 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:05 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-4f98fe9a-76d5-4e8f-8b2c-f2991898363a tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Created reservations ['6e831e5b-54dd-4e10-b06d-b15acf758383', '187b62dd-9e4c-4ac0-8a03-b33d1f668acb', '02d52274-c960-4bfd-a8a5-f1bad64b78f8', '9289db6b-ac6e-4360-a4eb-accd9366da29'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:14:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4f98fe9a-76d5-4e8f-8b2c-f2991898363a tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Delete snapshot completed successfully.
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4f98fe9a-76d5-4e8f-8b2c-f2991898363a tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Lock "cinder-2148401f-7aa8-43c6-8792-60829a4b843e-delete_snapshot" released by "delete_snapshot" :: held 1.885s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:06 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d" returned: 0 in 0.267s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e597d59e-7484-48a6-b619-97ebed87de5a tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.367s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4210480f-fc64-4c21-931d-188bfb48201b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46452794-4738-4a25-9399-bcd42700aa7d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25eba904-5dbf-4283-97d1-94cde916af25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-e597d59e-7484-48a6-b619-97ebed87de5a tempest-VolumesSnapshotListTestJSON-1670634772 None] Creating offline snapshot 3eece887-089f-4093-996d-4fa4c85068a9 of volume f115c8be-cc06-453f-9db6-a0988bf97661 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:14:06 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Volume volume-46452794-4738-4a25-9399-bcd42700aa7d (46452794-4738-4a25-9399-bcd42700aa7d): created successfully
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25eba904-5dbf-4283-97d1-94cde916af25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Flow 'volume_create_manager' (2caadcc9-f210-4942-a1c2-081733731de3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6723065-9846-4257-b9f2-1f47c6e15aeb]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e597d59e-7484-48a6-b619-97ebed87de5a tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b77616b6-0e18-4975-9083-235080aa509a tempest-CinderUnicodeTest-363760677 None] Created volume successfully.
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8e88c0f7-3b1a-4a6f-a0e3-ae5b2b91ebd8 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Acquiring lock "cinder-71550ac3-f1ce-4b5f-87b5-24ecd36cc079-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8e88c0f7-3b1a-4a6f-a0e3-ae5b2b91ebd8 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Lock "cinder-71550ac3-f1ce-4b5f-87b5-24ecd36cc079-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:06 devstack sudo[99611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5
Nov 05 15:14:06 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8e88c0f7-3b1a-4a6f-a0e3-ae5b2b91ebd8 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Acquiring lock "cinder-quobyte-71550ac3-f1ce-4b5f-87b5-24ecd36cc079" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8e88c0f7-3b1a-4a6f-a0e3-ae5b2b91ebd8 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Lock "cinder-quobyte-71550ac3-f1ce-4b5f-87b5-24ecd36cc079" acquired by "delete_volume" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8c027d-750d-4962-998a-4bcb5a045d86]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8e88c0f7-3b1a-4a6f-a0e3-ae5b2b91ebd8 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:06 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e597d59e-7484-48a6-b619-97ebed87de5a tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5" returned: 0 in 0.438s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-e597d59e-7484-48a6-b619-97ebed87de5a tempest-VolumesSnapshotListTestJSON-1670634772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f115c8be-cc06-453f-9db6-a0988bf97661(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e597d59e-7484-48a6-b619-97ebed87de5a tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:06 devstack sudo[99613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079
Nov 05 15:14:06 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:06 devstack sudo[99617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9 1G
Nov 05 15:14:06 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Flow 'volume_create_manager' (54f9c181-ea90-405b-96ae-a05a0d9c5eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f231b22-d8ed-4242-bc93-ad6ea987d491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f231b22-d8ed-4242-bc93-ad6ea987d491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-223729188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f834f77f-fcaf-4887-b9c6-09e5e84c4b70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fd20ae1aa294c28b636ce3d7164172f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:07Z,use_quota=True,user_id='bcd28db31e9946e38e806fbfffa2bc0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7514e5-09e5-44c1-ba45-ebc354734b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7514e5-09e5-44c1-ba45-ebc354734b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502e74c5-1bce-482b-bd18-623bf580a823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502e74c5-1bce-482b-bd18-623bf580a823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f834f77f-fcaf-4887-b9c6-09e5e84c4b70', 'volume_name': 'volume-f834f77f-fcaf-4887-b9c6-09e5e84c4b70', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9737a0c8-e92e-4caf-8013-3c87d1f5bf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9737a0c8-e92e-4caf-8013-3c87d1f5bf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d42fdc30-9d45-4356-b013-6ccfb865279e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:06 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Volume f834f77f-fcaf-4887-b9c6-09e5e84c4b70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f834f77f-fcaf-4887-b9c6-09e5e84c4b70', 'volume_size': 1}
Nov 05 15:14:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:07 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8e88c0f7-3b1a-4a6f-a0e3-ae5b2b91ebd8 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079" returned: 0 in 0.421s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8e88c0f7-3b1a-4a6f-a0e3-ae5b2b91ebd8 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:07 devstack sudo[99626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079
Nov 05 15:14:07 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:07 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e597d59e-7484-48a6-b619-97ebed87de5a tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9 1G" returned: 0 in 0.481s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e597d59e-7484-48a6-b619-97ebed87de5a tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:07 devstack sudo[99628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9
Nov 05 15:14:07 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:07 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8e88c0f7-3b1a-4a6f-a0e3-ae5b2b91ebd8 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-71550ac3-f1ce-4b5f-87b5-24ecd36cc079" returned: 0 in 0.280s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8e88c0f7-3b1a-4a6f-a0e3-ae5b2b91ebd8 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Lock "cinder-quobyte-71550ac3-f1ce-4b5f-87b5-24ecd36cc079" released by "delete_volume" :: held 0.819s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-8e88c0f7-3b1a-4a6f-a0e3-ae5b2b91ebd8 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Created reservations ['875d1792-2853-4ea6-afad-3cdb36c20d0b', '716fe4f0-3f58-4150-8145-83729b5c5e6b', 'b503ebaf-f3cd-49ae-a55c-2baf484ba3bf', 'b5a40e50-67b4-46d3-b175-29d4d22b2ca4'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8e88c0f7-3b1a-4a6f-a0e3-ae5b2b91ebd8 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8e88c0f7-3b1a-4a6f-a0e3-ae5b2b91ebd8 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8e88c0f7-3b1a-4a6f-a0e3-ae5b2b91ebd8 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8e88c0f7-3b1a-4a6f-a0e3-ae5b2b91ebd8 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8e88c0f7-3b1a-4a6f-a0e3-ae5b2b91ebd8 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8e88c0f7-3b1a-4a6f-a0e3-ae5b2b91ebd8 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:07 devstack sudo[99633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:14:07 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5d573c0a-7bd5-41e8-993e-b2d8ee072602 tempest-CinderUnicodeTest-363760677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:07 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e597d59e-7484-48a6-b619-97ebed87de5a tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9" returned: 0 in 0.383s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:07 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-e597d59e-7484-48a6-b619-97ebed87de5a tempest-VolumesSnapshotListTestJSON-1670634772 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9 is being set with open permissions: ugo+rw
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e597d59e-7484-48a6-b619-97ebed87de5a tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:07 devstack sudo[99636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9
Nov 05 15:14:07 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:07 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8e88c0f7-3b1a-4a6f-a0e3-ae5b2b91ebd8 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.318s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-8e88c0f7-3b1a-4a6f-a0e3-ae5b2b91ebd8 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:14:07 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-8e88c0f7-3b1a-4a6f-a0e3-ae5b2b91ebd8 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Deleted volume successfully.
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8e88c0f7-3b1a-4a6f-a0e3-ae5b2b91ebd8 tempest-VolumesSnapshotNegativeTestJSON-1645135551 None] Lock "cinder-71550ac3-f1ce-4b5f-87b5-24ecd36cc079-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:07 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e597d59e-7484-48a6-b619-97ebed87de5a tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9" returned: 0 in 0.287s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e597d59e-7484-48a6-b619-97ebed87de5a tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.746s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-223729188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f834f77f-fcaf-4887-b9c6-09e5e84c4b70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fd20ae1aa294c28b636ce3d7164172f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:07Z,use_quota=True,user_id='bcd28db31e9946e38e806fbfffa2bc0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Creating volume f834f77f-fcaf-4887-b9c6-09e5e84c4b70 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:14:07 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f834f77f-fcaf-4887-b9c6-09e5e84c4b70 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:07 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=129,cinder:UPDATE=149,cinder:INSERT=42,cinder:DELETE=14 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:14:07 devstack sudo[99640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f834f77f-fcaf-4887-b9c6-09e5e84c4b70 1073741824
Nov 05 15:14:07 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:07 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e597d59e-7484-48a6-b619-97ebed87de5a tempest-VolumesSnapshotListTestJSON-1670634772 None] Create snapshot completed successfully
Nov 05 15:14:08 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f834f77f-fcaf-4887-b9c6-09e5e84c4b70 1073741824" returned: 0 in 0.453s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f834f77f-fcaf-4887-b9c6-09e5e84c4b70 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:08 devstack sudo[99646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f834f77f-fcaf-4887-b9c6-09e5e84c4b70
Nov 05 15:14:08 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:08 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f834f77f-fcaf-4887-b9c6-09e5e84c4b70" returned: 0 in 0.275s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:14:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5d573c0a-7bd5-41e8-993e-b2d8ee072602 tempest-CinderUnicodeTest-363760677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.110s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d42fdc30-9d45-4356-b013-6ccfb865279e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f834f77f-fcaf-4887-b9c6-09e5e84c4b70', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dbcc72b-8944-48f9-95c8-e632b57b83f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-5d573c0a-7bd5-41e8-993e-b2d8ee072602 tempest-CinderUnicodeTest-363760677 None] Creating offline snapshot 1c8096bf-9e6a-443b-a5cc-d15410d60ae5 of volume 46452794-4738-4a25-9399-bcd42700aa7d {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:14:08 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Volume volume-f834f77f-fcaf-4887-b9c6-09e5e84c4b70 (f834f77f-fcaf-4887-b9c6-09e5e84c4b70): created successfully
Nov 05 15:14:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dbcc72b-8944-48f9-95c8-e632b57b83f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Flow 'volume_create_manager' (54f9c181-ea90-405b-96ae-a05a0d9c5eba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:14:08 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[810ecd0f-f53f-44a4-be79-1b16119afb90]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d573c0a-7bd5-41e8-993e-b2d8ee072602 tempest-CinderUnicodeTest-363760677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:08 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c5d2beb9-0b61-449b-bddd-6e560f5fb3a3 tempest-AttachVolumeTestJSON-2065852907 None] Created volume successfully.
Nov 05 15:14:08 devstack sudo[99649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d
Nov 05 15:14:08 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2df15e4d-5b62-4910-a6fd-2713598cb804 tempest-VolumesSnapshotListTestJSON-1670634772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:09 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d573c0a-7bd5-41e8-993e-b2d8ee072602 tempest-CinderUnicodeTest-363760677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d" returned: 0 in 0.467s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d573c0a-7bd5-41e8-993e-b2d8ee072602 tempest-CinderUnicodeTest-363760677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.1c8096bf-9e6a-443b-a5cc-d15410d60ae5 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:09 devstack sudo[99655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.1c8096bf-9e6a-443b-a5cc-d15410d60ae5 1G
Nov 05 15:14:09 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:09 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d573c0a-7bd5-41e8-993e-b2d8ee072602 tempest-CinderUnicodeTest-363760677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.1c8096bf-9e6a-443b-a5cc-d15410d60ae5 1G" returned: 0 in 0.469s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d573c0a-7bd5-41e8-993e-b2d8ee072602 tempest-CinderUnicodeTest-363760677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46452794-4738-4a25-9399-bcd42700aa7d -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.1c8096bf-9e6a-443b-a5cc-d15410d60ae5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:09 devstack sudo[99662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46452794-4738-4a25-9399-bcd42700aa7d -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.1c8096bf-9e6a-443b-a5cc-d15410d60ae5
Nov 05 15:14:09 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:10 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d573c0a-7bd5-41e8-993e-b2d8ee072602 tempest-CinderUnicodeTest-363760677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46452794-4738-4a25-9399-bcd42700aa7d -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.1c8096bf-9e6a-443b-a5cc-d15410d60ae5" returned: 0 in 0.318s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:10 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-5d573c0a-7bd5-41e8-993e-b2d8ee072602 tempest-CinderUnicodeTest-363760677 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.1c8096bf-9e6a-443b-a5cc-d15410d60ae5 is being set with open permissions: ugo+rw
Nov 05 15:14:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d573c0a-7bd5-41e8-993e-b2d8ee072602 tempest-CinderUnicodeTest-363760677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.1c8096bf-9e6a-443b-a5cc-d15410d60ae5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:10 devstack sudo[99669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.1c8096bf-9e6a-443b-a5cc-d15410d60ae5
Nov 05 15:14:10 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:10 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d573c0a-7bd5-41e8-993e-b2d8ee072602 tempest-CinderUnicodeTest-363760677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.1c8096bf-9e6a-443b-a5cc-d15410d60ae5" returned: 0 in 0.310s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:10 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=126,cinder:INSERT=44,cinder:UPDATE=158,cinder:DELETE=13 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:14:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d573c0a-7bd5-41e8-993e-b2d8ee072602 tempest-CinderUnicodeTest-363760677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:10 devstack sudo[99673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.info
Nov 05 15:14:10 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:10 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d573c0a-7bd5-41e8-993e-b2d8ee072602 tempest-CinderUnicodeTest-363760677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.info" returned: 0 in 0.351s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:10 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-5d573c0a-7bd5-41e8-993e-b2d8ee072602 tempest-CinderUnicodeTest-363760677 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.info is being set with open permissions: ugo+rw
Nov 05 15:14:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d573c0a-7bd5-41e8-993e-b2d8ee072602 tempest-CinderUnicodeTest-363760677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:10 devstack sudo[99684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.info
Nov 05 15:14:10 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-d74dc183-575d-4af4-ae16-e09b8b949e62 req-36be2a2b-a735-4cc3-b33d-ce365ec66686 tempest-AttachVolumeTestJSON-2065852907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:11 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d573c0a-7bd5-41e8-993e-b2d8ee072602 tempest-CinderUnicodeTest-363760677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.info" returned: 0 in 0.298s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5d573c0a-7bd5-41e8-993e-b2d8ee072602 tempest-CinderUnicodeTest-363760677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.366s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2df15e4d-5b62-4910-a6fd-2713598cb804 tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.891s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-2df15e4d-5b62-4910-a6fd-2713598cb804 tempest-VolumesSnapshotListTestJSON-1670634772 None] Creating offline snapshot 764103e3-861c-43b7-ac2e-c764a5916e8e of volume f115c8be-cc06-453f-9db6-a0988bf97661 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:14:11 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5d573c0a-7bd5-41e8-993e-b2d8ee072602 tempest-CinderUnicodeTest-363760677 None] Create snapshot completed successfully
Nov 05 15:14:11 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7682b1df-0adc-4f98-a850-11daa059163e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2df15e4d-5b62-4910-a6fd-2713598cb804 tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:11 devstack sudo[99687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9
Nov 05 15:14:11 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:11 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2df15e4d-5b62-4910-a6fd-2713598cb804 tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9" returned: 0 in 0.432s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-2df15e4d-5b62-4910-a6fd-2713598cb804 tempest-VolumesSnapshotListTestJSON-1670634772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f115c8be-cc06-453f-9db6-a0988bf97661(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:14:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2df15e4d-5b62-4910-a6fd-2713598cb804 tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.764103e3-861c-43b7-ac2e-c764a5916e8e 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:11 devstack sudo[99692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.764103e3-861c-43b7-ac2e-c764a5916e8e 1G
Nov 05 15:14:11 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-09df3778-6716-4dbc-ad3b-d1d32817018b tempest-CinderUnicodeTest-363760677 None] Acquiring lock "cinder-1c8096bf-9e6a-443b-a5cc-d15410d60ae5-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-09df3778-6716-4dbc-ad3b-d1d32817018b tempest-CinderUnicodeTest-363760677 None] Lock "cinder-1c8096bf-9e6a-443b-a5cc-d15410d60ae5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-09df3778-6716-4dbc-ad3b-d1d32817018b tempest-CinderUnicodeTest-363760677 None] Acquiring lock "cinder-quobyte-46452794-4738-4a25-9399-bcd42700aa7d" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-09df3778-6716-4dbc-ad3b-d1d32817018b tempest-CinderUnicodeTest-363760677 None] Lock "cinder-quobyte-46452794-4738-4a25-9399-bcd42700aa7d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-09df3778-6716-4dbc-ad3b-d1d32817018b tempest-CinderUnicodeTest-363760677 None] Acquiring lock "cinder-quobyte-1c8096bf-9e6a-443b-a5cc-d15410d60ae5" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-09df3778-6716-4dbc-ad3b-d1d32817018b tempest-CinderUnicodeTest-363760677 None] Lock "cinder-quobyte-1c8096bf-9e6a-443b-a5cc-d15410d60ae5" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-09df3778-6716-4dbc-ad3b-d1d32817018b tempest-CinderUnicodeTest-363760677 None] Deleting offline snapshot 1c8096bf-9e6a-443b-a5cc-d15410d60ae5 of volume 46452794-4738-4a25-9399-bcd42700aa7d {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:14:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-09df3778-6716-4dbc-ad3b-d1d32817018b tempest-CinderUnicodeTest-363760677 None] snapshot_file for this snap is: volume-46452794-4738-4a25-9399-bcd42700aa7d.1c8096bf-9e6a-443b-a5cc-d15410d60ae5 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:14:12 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[af21d978-68c0-47e2-ad6d-d69703f80e2c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-09df3778-6716-4dbc-ad3b-d1d32817018b tempest-CinderUnicodeTest-363760677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.1c8096bf-9e6a-443b-a5cc-d15410d60ae5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:12 devstack sudo[99699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.1c8096bf-9e6a-443b-a5cc-d15410d60ae5
Nov 05 15:14:12 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:12 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2df15e4d-5b62-4910-a6fd-2713598cb804 tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.764103e3-861c-43b7-ac2e-c764a5916e8e 1G" returned: 0 in 0.675s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2df15e4d-5b62-4910-a6fd-2713598cb804 tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.764103e3-861c-43b7-ac2e-c764a5916e8e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:12 devstack sudo[99701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.764103e3-861c-43b7-ac2e-c764a5916e8e
Nov 05 15:14:12 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:12 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-09df3778-6716-4dbc-ad3b-d1d32817018b tempest-CinderUnicodeTest-363760677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.1c8096bf-9e6a-443b-a5cc-d15410d60ae5" returned: 0 in 0.425s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-09df3778-6716-4dbc-ad3b-d1d32817018b tempest-CinderUnicodeTest-363760677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46452794-4738-4a25-9399-bcd42700aa7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:14:12 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[20630797-c33f-4ace-a35a-f4ea01198a84]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-09df3778-6716-4dbc-ad3b-d1d32817018b tempest-CinderUnicodeTest-363760677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:12 devstack sudo[99706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d
Nov 05 15:14:12 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:12 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2df15e4d-5b62-4910-a6fd-2713598cb804 tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.764103e3-861c-43b7-ac2e-c764a5916e8e" returned: 0 in 0.343s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:12 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-2df15e4d-5b62-4910-a6fd-2713598cb804 tempest-VolumesSnapshotListTestJSON-1670634772 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.764103e3-861c-43b7-ac2e-c764a5916e8e is being set with open permissions: ugo+rw
Nov 05 15:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2df15e4d-5b62-4910-a6fd-2713598cb804 tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.764103e3-861c-43b7-ac2e-c764a5916e8e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:12 devstack sudo[99711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.764103e3-861c-43b7-ac2e-c764a5916e8e
Nov 05 15:14:12 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:12 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-09df3778-6716-4dbc-ad3b-d1d32817018b tempest-CinderUnicodeTest-363760677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d" returned: 0 in 0.417s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:12 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-09df3778-6716-4dbc-ad3b-d1d32817018b tempest-CinderUnicodeTest-363760677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.1c8096bf-9e6a-443b-a5cc-d15410d60ae5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2df15e4d-5b62-4910-a6fd-2713598cb804 tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.764103e3-861c-43b7-ac2e-c764a5916e8e" returned: 0 in 0.287s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:12 devstack sudo[99717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.1c8096bf-9e6a-443b-a5cc-d15410d60ae5
Nov 05 15:14:12 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2df15e4d-5b62-4910-a6fd-2713598cb804 tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.875s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-d74dc183-575d-4af4-ae16-e09b8b949e62 req-36be2a2b-a735-4cc3-b33d-ce365ec66686 tempest-AttachVolumeTestJSON-2065852907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.070s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-d74dc183-575d-4af4-ae16-e09b8b949e62 req-36be2a2b-a735-4cc3-b33d-ce365ec66686 tempest-AttachVolumeTestJSON-2065852907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:12 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2df15e4d-5b62-4910-a6fd-2713598cb804 tempest-VolumesSnapshotListTestJSON-1670634772 None] Create snapshot completed successfully
Nov 05 15:14:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-d74dc183-575d-4af4-ae16-e09b8b949e62 req-36be2a2b-a735-4cc3-b33d-ce365ec66686 tempest-AttachVolumeTestJSON-2065852907 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628', 'name': 'volume-f834f77f-fcaf-4887-b9c6-09e5e84c4b70', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '95bf1ccc-18d2-45f5-be09-2fc0bdf1b3ad', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 15:14:13 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-d74dc183-575d-4af4-ae16-e09b8b949e62 req-36be2a2b-a735-4cc3-b33d-ce365ec66686 tempest-AttachVolumeTestJSON-2065852907 None] attachment_update completed successfully.
Nov 05 15:14:13 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-09df3778-6716-4dbc-ad3b-d1d32817018b tempest-CinderUnicodeTest-363760677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.1c8096bf-9e6a-443b-a5cc-d15410d60ae5" returned: 0 in 0.433s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-09df3778-6716-4dbc-ad3b-d1d32817018b tempest-CinderUnicodeTest-363760677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.1c8096bf-9e6a-443b-a5cc-d15410d60ae5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:13 devstack sudo[99800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.1c8096bf-9e6a-443b-a5cc-d15410d60ae5
Nov 05 15:14:13 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:13 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-09df3778-6716-4dbc-ad3b-d1d32817018b tempest-CinderUnicodeTest-363760677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d.1c8096bf-9e6a-443b-a5cc-d15410d60ae5" returned: 0 in 0.356s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-09df3778-6716-4dbc-ad3b-d1d32817018b tempest-CinderUnicodeTest-363760677 None] Lock "cinder-quobyte-1c8096bf-9e6a-443b-a5cc-d15410d60ae5" released by "_delete_snapshot" :: held 1.806s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-09df3778-6716-4dbc-ad3b-d1d32817018b tempest-CinderUnicodeTest-363760677 None] Lock "cinder-quobyte-46452794-4738-4a25-9399-bcd42700aa7d" released by "delete_snapshot" :: held 1.856s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:13 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-09df3778-6716-4dbc-ad3b-d1d32817018b tempest-CinderUnicodeTest-363760677 None] Created reservations ['eb6ee665-c741-4fda-88c9-6d7e6b698e4b', 'd3163426-ce88-4118-80c4-f7e55364c09e', '6e7a57d5-07bb-48cc-b836-9c8f01c26276', 'de2cba2d-6a53-41f6-8df7-293e2dd5c1be'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:14:14 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-09df3778-6716-4dbc-ad3b-d1d32817018b tempest-CinderUnicodeTest-363760677 None] Delete snapshot completed successfully.
Nov 05 15:14:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-09df3778-6716-4dbc-ad3b-d1d32817018b tempest-CinderUnicodeTest-363760677 None] Lock "cinder-1c8096bf-9e6a-443b-a5cc-d15410d60ae5-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1538a787-b8af-49dd-93ff-47a47b8d92e5 tempest-CinderUnicodeTest-363760677 None] Acquiring lock "cinder-46452794-4738-4a25-9399-bcd42700aa7d-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1538a787-b8af-49dd-93ff-47a47b8d92e5 tempest-CinderUnicodeTest-363760677 None] Lock "cinder-46452794-4738-4a25-9399-bcd42700aa7d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1538a787-b8af-49dd-93ff-47a47b8d92e5 tempest-CinderUnicodeTest-363760677 None] Acquiring lock "cinder-quobyte-46452794-4738-4a25-9399-bcd42700aa7d" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1538a787-b8af-49dd-93ff-47a47b8d92e5 tempest-CinderUnicodeTest-363760677 None] Lock "cinder-quobyte-46452794-4738-4a25-9399-bcd42700aa7d" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:14 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4829fac6-cb87-4448-9516-7fea4246d4f9]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1538a787-b8af-49dd-93ff-47a47b8d92e5 tempest-CinderUnicodeTest-363760677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:14 devstack sudo[100141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d
Nov 05 15:14:14 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-57f511f6-3914-4870-aea9-de026f00c1e6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Acquiring lock "cinder-764103e3-861c-43b7-ac2e-c764a5916e8e-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-57f511f6-3914-4870-aea9-de026f00c1e6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "cinder-764103e3-861c-43b7-ac2e-c764a5916e8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-57f511f6-3914-4870-aea9-de026f00c1e6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Acquiring lock "cinder-quobyte-f115c8be-cc06-453f-9db6-a0988bf97661" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-57f511f6-3914-4870-aea9-de026f00c1e6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "cinder-quobyte-f115c8be-cc06-453f-9db6-a0988bf97661" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-57f511f6-3914-4870-aea9-de026f00c1e6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Acquiring lock "cinder-quobyte-764103e3-861c-43b7-ac2e-c764a5916e8e" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-57f511f6-3914-4870-aea9-de026f00c1e6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "cinder-quobyte-764103e3-861c-43b7-ac2e-c764a5916e8e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-57f511f6-3914-4870-aea9-de026f00c1e6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Deleting offline snapshot 764103e3-861c-43b7-ac2e-c764a5916e8e of volume f115c8be-cc06-453f-9db6-a0988bf97661 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:14:15 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-57f511f6-3914-4870-aea9-de026f00c1e6 tempest-VolumesSnapshotListTestJSON-1670634772 None] snapshot_file for this snap is: volume-f115c8be-cc06-453f-9db6-a0988bf97661.764103e3-861c-43b7-ac2e-c764a5916e8e {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1538a787-b8af-49dd-93ff-47a47b8d92e5 tempest-CinderUnicodeTest-363760677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d" returned: 0 in 0.563s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1538a787-b8af-49dd-93ff-47a47b8d92e5 tempest-CinderUnicodeTest-363760677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a813dd60-8460-4619-abb9-e1f31ad29473]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-57f511f6-3914-4870-aea9-de026f00c1e6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.764103e3-861c-43b7-ac2e-c764a5916e8e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:15 devstack sudo[100147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d
Nov 05 15:14:15 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:15 devstack sudo[100148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.764103e3-861c-43b7-ac2e-c764a5916e8e
Nov 05 15:14:15 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:15 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1538a787-b8af-49dd-93ff-47a47b8d92e5 tempest-CinderUnicodeTest-363760677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-46452794-4738-4a25-9399-bcd42700aa7d" returned: 0 in 0.299s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1538a787-b8af-49dd-93ff-47a47b8d92e5 tempest-CinderUnicodeTest-363760677 None] Lock "cinder-quobyte-46452794-4738-4a25-9399-bcd42700aa7d" released by "delete_volume" :: held 0.986s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-1538a787-b8af-49dd-93ff-47a47b8d92e5 tempest-CinderUnicodeTest-363760677 None] Created reservations ['62197f38-aa30-45ba-ae98-c6c0624f720e', 'b76ffce9-4665-48b8-ae27-8bf14f1cd5b8', 'f6383bd0-348e-439b-9a58-01d8585b4b99', 'af302db8-9ca1-40ed-9cb0-34add97c09de'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1538a787-b8af-49dd-93ff-47a47b8d92e5 tempest-CinderUnicodeTest-363760677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1538a787-b8af-49dd-93ff-47a47b8d92e5 tempest-CinderUnicodeTest-363760677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1538a787-b8af-49dd-93ff-47a47b8d92e5 tempest-CinderUnicodeTest-363760677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:14:15 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1538a787-b8af-49dd-93ff-47a47b8d92e5 tempest-CinderUnicodeTest-363760677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1538a787-b8af-49dd-93ff-47a47b8d92e5 tempest-CinderUnicodeTest-363760677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1538a787-b8af-49dd-93ff-47a47b8d92e5 tempest-CinderUnicodeTest-363760677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-57f511f6-3914-4870-aea9-de026f00c1e6 tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.764103e3-861c-43b7-ac2e-c764a5916e8e" returned: 0 in 0.516s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-57f511f6-3914-4870-aea9-de026f00c1e6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f115c8be-cc06-453f-9db6-a0988bf97661(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:14:15 devstack sudo[100155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:14:15 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc7adc6-6ebf-4560-870c-386302c09e72]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-57f511f6-3914-4870-aea9-de026f00c1e6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:15 devstack sudo[100157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9
Nov 05 15:14:15 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:15 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1538a787-b8af-49dd-93ff-47a47b8d92e5 tempest-CinderUnicodeTest-363760677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.300s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-1538a787-b8af-49dd-93ff-47a47b8d92e5 tempest-CinderUnicodeTest-363760677 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:14:15 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1538a787-b8af-49dd-93ff-47a47b8d92e5 tempest-CinderUnicodeTest-363760677 None] Deleted volume successfully.
Nov 05 15:14:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1538a787-b8af-49dd-93ff-47a47b8d92e5 tempest-CinderUnicodeTest-363760677 None] Lock "cinder-46452794-4738-4a25-9399-bcd42700aa7d-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Flow 'volume_create_manager' (b5a1a698-24e1-4371-acbe-f479824c104d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2694438f-60c6-4c79-8c0d-c53330ee450b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2694438f-60c6-4c79-8c0d-c53330ee450b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2039623495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f40ddea-1476-4372-8112-4bf339b21f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fd20ae1aa294c28b636ce3d7164172f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:16Z,use_quota=True,user_id='bcd28db31e9946e38e806fbfffa2bc0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd061991-dbda-443c-80f7-67790802ef77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd061991-dbda-443c-80f7-67790802ef77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc981eb6-612d-478c-b4cb-08a7f2aac107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc981eb6-612d-478c-b4cb-08a7f2aac107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f40ddea-1476-4372-8112-4bf339b21f95', 'volume_name': 'volume-5f40ddea-1476-4372-8112-4bf339b21f95', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:16 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec554b7-3b06-40bd-8e33-c08bceb074cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec554b7-3b06-40bd-8e33-c08bceb074cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0aeb41-29ae-49f3-89ef-b0834303e110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:16 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Volume 5f40ddea-1476-4372-8112-4bf339b21f95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f40ddea-1476-4372-8112-4bf339b21f95', 'volume_size': 1}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2039623495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f40ddea-1476-4372-8112-4bf339b21f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fd20ae1aa294c28b636ce3d7164172f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:16Z,use_quota=True,user_id='bcd28db31e9946e38e806fbfffa2bc0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Creating volume 5f40ddea-1476-4372-8112-4bf339b21f95 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:14:16 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5f40ddea-1476-4372-8112-4bf339b21f95 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-57f511f6-3914-4870-aea9-de026f00c1e6 tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9" returned: 0 in 0.495s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-57f511f6-3914-4870-aea9-de026f00c1e6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f115c8be-cc06-453f-9db6-a0988bf97661(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-57f511f6-3914-4870-aea9-de026f00c1e6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.764103e3-861c-43b7-ac2e-c764a5916e8e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:16 devstack sudo[100163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5f40ddea-1476-4372-8112-4bf339b21f95 1073741824
Nov 05 15:14:16 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:16 devstack sudo[100164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.764103e3-861c-43b7-ac2e-c764a5916e8e
Nov 05 15:14:16 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-98066a99-62cd-4787-897a-8d55ce6b1f3d tempest-CinderUnicodeTest-363760677 None] Acquiring lock "cinder-cf23da7d-c6c3-45f1-97d3-da2346975968-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-98066a99-62cd-4787-897a-8d55ce6b1f3d tempest-CinderUnicodeTest-363760677 None] Lock "cinder-cf23da7d-c6c3-45f1-97d3-da2346975968-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-98066a99-62cd-4787-897a-8d55ce6b1f3d tempest-CinderUnicodeTest-363760677 None] Acquiring lock "cinder-quobyte-cf23da7d-c6c3-45f1-97d3-da2346975968" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:16 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5f40ddea-1476-4372-8112-4bf339b21f95 1073741824" returned: 0 in 0.708s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-98066a99-62cd-4787-897a-8d55ce6b1f3d tempest-CinderUnicodeTest-363760677 None] Lock "cinder-quobyte-cf23da7d-c6c3-45f1-97d3-da2346975968" acquired by "delete_volume" :: waited 0.033s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:16 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-57f511f6-3914-4870-aea9-de026f00c1e6 tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.764103e3-861c-43b7-ac2e-c764a5916e8e" returned: 0 in 0.732s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-57f511f6-3914-4870-aea9-de026f00c1e6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.764103e3-861c-43b7-ac2e-c764a5916e8e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a67bf6-007d-4fc5-90f6-2555a58e5aed]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-98066a99-62cd-4787-897a-8d55ce6b1f3d tempest-CinderUnicodeTest-363760677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cf23da7d-c6c3-45f1-97d3-da2346975968 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:16 devstack sudo[100175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.764103e3-861c-43b7-ac2e-c764a5916e8e
Nov 05 15:14:16 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5f40ddea-1476-4372-8112-4bf339b21f95 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:17 devstack sudo[100178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5f40ddea-1476-4372-8112-4bf339b21f95
Nov 05 15:14:17 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:17 devstack sudo[100176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cf23da7d-c6c3-45f1-97d3-da2346975968
Nov 05 15:14:17 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:17 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-57f511f6-3914-4870-aea9-de026f00c1e6 tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.764103e3-861c-43b7-ac2e-c764a5916e8e" returned: 0 in 0.397s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-57f511f6-3914-4870-aea9-de026f00c1e6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "cinder-quobyte-764103e3-861c-43b7-ac2e-c764a5916e8e" released by "_delete_snapshot" :: held 2.305s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-57f511f6-3914-4870-aea9-de026f00c1e6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "cinder-quobyte-f115c8be-cc06-453f-9db6-a0988bf97661" released by "delete_snapshot" :: held 2.342s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:17 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5f40ddea-1476-4372-8112-4bf339b21f95" returned: 0 in 0.355s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:14:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0aeb41-29ae-49f3-89ef-b0834303e110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f40ddea-1476-4372-8112-4bf339b21f95', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57d8fd27-5b6e-4a63-96bf-396bb56e705d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:17 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-98066a99-62cd-4787-897a-8d55ce6b1f3d tempest-CinderUnicodeTest-363760677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cf23da7d-c6c3-45f1-97d3-da2346975968" returned: 0 in 0.473s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-98066a99-62cd-4787-897a-8d55ce6b1f3d tempest-CinderUnicodeTest-363760677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cf23da7d-c6c3-45f1-97d3-da2346975968 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:17 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Volume volume-5f40ddea-1476-4372-8112-4bf339b21f95 (5f40ddea-1476-4372-8112-4bf339b21f95): created successfully
Nov 05 15:14:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57d8fd27-5b6e-4a63-96bf-396bb56e705d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:17 devstack sudo[100186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cf23da7d-c6c3-45f1-97d3-da2346975968
Nov 05 15:14:17 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Flow 'volume_create_manager' (b5a1a698-24e1-4371-acbe-f479824c104d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:14:17 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a9f158b0-df77-483b-aff0-34d5860b8122 tempest-AttachVolumeTestJSON-2065852907 None] Created volume successfully.
Nov 05 15:14:17 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-57f511f6-3914-4870-aea9-de026f00c1e6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Created reservations ['185b0136-a275-4aba-b934-f50a79b5bc98', '58f680ab-429a-4c13-be20-c7160f318301', 'd8fb3c89-c8ee-408c-ba8a-1d84390f8d1b', 'fd8ee68a-15b7-4d0d-8593-8f2683f2b9a7'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:14:17 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-57f511f6-3914-4870-aea9-de026f00c1e6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Delete snapshot completed successfully.
Nov 05 15:14:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-57f511f6-3914-4870-aea9-de026f00c1e6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "cinder-764103e3-861c-43b7-ac2e-c764a5916e8e-delete_snapshot" released by "delete_snapshot" :: held 2.575s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:17 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-98066a99-62cd-4787-897a-8d55ce6b1f3d tempest-CinderUnicodeTest-363760677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cf23da7d-c6c3-45f1-97d3-da2346975968" returned: 0 in 0.287s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-98066a99-62cd-4787-897a-8d55ce6b1f3d tempest-CinderUnicodeTest-363760677 None] Lock "cinder-quobyte-cf23da7d-c6c3-45f1-97d3-da2346975968" released by "delete_volume" :: held 0.851s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:17 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-98066a99-62cd-4787-897a-8d55ce6b1f3d tempest-CinderUnicodeTest-363760677 None] Created reservations ['bb275ade-5ffc-4e8c-afcc-57dc13b28db2', '5a3e8a79-1874-40f9-b4ce-e0030c3af06e', '4415c518-d127-4e5f-82c3-1121e1015c41', 'da85c9a0-3eec-4464-9d7d-03afd31a849f'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:14:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-98066a99-62cd-4787-897a-8d55ce6b1f3d tempest-CinderUnicodeTest-363760677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-98066a99-62cd-4787-897a-8d55ce6b1f3d tempest-CinderUnicodeTest-363760677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-98066a99-62cd-4787-897a-8d55ce6b1f3d tempest-CinderUnicodeTest-363760677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:14:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-98066a99-62cd-4787-897a-8d55ce6b1f3d tempest-CinderUnicodeTest-363760677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:14:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-98066a99-62cd-4787-897a-8d55ce6b1f3d tempest-CinderUnicodeTest-363760677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-98066a99-62cd-4787-897a-8d55ce6b1f3d tempest-CinderUnicodeTest-363760677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:17 devstack sudo[100191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:14:17 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:18 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-98066a99-62cd-4787-897a-8d55ce6b1f3d tempest-CinderUnicodeTest-363760677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.306s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:18 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-98066a99-62cd-4787-897a-8d55ce6b1f3d tempest-CinderUnicodeTest-363760677 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:14:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-98066a99-62cd-4787-897a-8d55ce6b1f3d tempest-CinderUnicodeTest-363760677 None] Deleted volume successfully.
Nov 05 15:14:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-98066a99-62cd-4787-897a-8d55ce6b1f3d tempest-CinderUnicodeTest-363760677 None] Lock "cinder-cf23da7d-c6c3-45f1-97d3-da2346975968-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7d50b04e-7119-4fe7-9b5f-2b98be36e30f tempest-VolumesSnapshotListTestJSON-1670634772 None] Acquiring lock "cinder-3eece887-089f-4093-996d-4fa4c85068a9-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7d50b04e-7119-4fe7-9b5f-2b98be36e30f tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "cinder-3eece887-089f-4093-996d-4fa4c85068a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7d50b04e-7119-4fe7-9b5f-2b98be36e30f tempest-VolumesSnapshotListTestJSON-1670634772 None] Acquiring lock "cinder-quobyte-f115c8be-cc06-453f-9db6-a0988bf97661" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7d50b04e-7119-4fe7-9b5f-2b98be36e30f tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "cinder-quobyte-f115c8be-cc06-453f-9db6-a0988bf97661" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7d50b04e-7119-4fe7-9b5f-2b98be36e30f tempest-VolumesSnapshotListTestJSON-1670634772 None] Acquiring lock "cinder-quobyte-3eece887-089f-4093-996d-4fa4c85068a9" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7d50b04e-7119-4fe7-9b5f-2b98be36e30f tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "cinder-quobyte-3eece887-089f-4093-996d-4fa4c85068a9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7d50b04e-7119-4fe7-9b5f-2b98be36e30f tempest-VolumesSnapshotListTestJSON-1670634772 None] Deleting offline snapshot 3eece887-089f-4093-996d-4fa4c85068a9 of volume f115c8be-cc06-453f-9db6-a0988bf97661 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:14:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7d50b04e-7119-4fe7-9b5f-2b98be36e30f tempest-VolumesSnapshotListTestJSON-1670634772 None] snapshot_file for this snap is: volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:14:18 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a545c63-c4fa-4b15-b772-7c8d1083f705]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d50b04e-7119-4fe7-9b5f-2b98be36e30f tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:18 devstack sudo[100197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9
Nov 05 15:14:18 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:19 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d50b04e-7119-4fe7-9b5f-2b98be36e30f tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9" returned: 0 in 0.750s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7d50b04e-7119-4fe7-9b5f-2b98be36e30f tempest-VolumesSnapshotListTestJSON-1670634772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f115c8be-cc06-453f-9db6-a0988bf97661(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:14:19 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edd8c9e-e1fd-41b9-9052-66aafc794f8f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d50b04e-7119-4fe7-9b5f-2b98be36e30f tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-7c387044-6c8c-4081-8433-9d5ef7d97433 req-ad9a3358-a22a-4ce1-8f01-8da9bfd8aea2 tempest-AttachVolumeTestJSON-2065852907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-7c387044-6c8c-4081-8433-9d5ef7d97433 req-ad9a3358-a22a-4ce1-8f01-8da9bfd8aea2 tempest-AttachVolumeTestJSON-2065852907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-7c387044-6c8c-4081-8433-9d5ef7d97433 req-ad9a3358-a22a-4ce1-8f01-8da9bfd8aea2 tempest-AttachVolumeTestJSON-2065852907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:19 devstack sudo[100245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5
Nov 05 15:14:19 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-7c387044-6c8c-4081-8433-9d5ef7d97433 req-ad9a3358-a22a-4ce1-8f01-8da9bfd8aea2 tempest-AttachVolumeTestJSON-2065852907 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628', 'name': 'volume-5f40ddea-1476-4372-8112-4bf339b21f95', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '34a5f612-9ce2-4473-9019-4a0140ca5843', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 15:14:19 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-7c387044-6c8c-4081-8433-9d5ef7d97433 req-ad9a3358-a22a-4ce1-8f01-8da9bfd8aea2 tempest-AttachVolumeTestJSON-2065852907 None] attachment_update completed successfully.
Nov 05 15:14:19 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d50b04e-7119-4fe7-9b5f-2b98be36e30f tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5" returned: 0 in 0.610s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7d50b04e-7119-4fe7-9b5f-2b98be36e30f tempest-VolumesSnapshotListTestJSON-1670634772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f115c8be-cc06-453f-9db6-a0988bf97661(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:14:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d50b04e-7119-4fe7-9b5f-2b98be36e30f tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:19 devstack sudo[100252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9
Nov 05 15:14:19 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:20 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d50b04e-7119-4fe7-9b5f-2b98be36e30f tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9" returned: 0 in 0.864s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d50b04e-7119-4fe7-9b5f-2b98be36e30f tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:20 devstack sudo[100266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9
Nov 05 15:14:20 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:20 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d50b04e-7119-4fe7-9b5f-2b98be36e30f tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.3eece887-089f-4093-996d-4fa4c85068a9" returned: 0 in 0.291s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7d50b04e-7119-4fe7-9b5f-2b98be36e30f tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "cinder-quobyte-3eece887-089f-4093-996d-4fa4c85068a9" released by "_delete_snapshot" :: held 2.694s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7d50b04e-7119-4fe7-9b5f-2b98be36e30f tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "cinder-quobyte-f115c8be-cc06-453f-9db6-a0988bf97661" released by "delete_snapshot" :: held 2.720s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:21 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-7d50b04e-7119-4fe7-9b5f-2b98be36e30f tempest-VolumesSnapshotListTestJSON-1670634772 None] Created reservations ['926c0b51-f9c6-449e-9c5e-c55b4ee54479', '03d1ebd6-a97f-4714-985b-06cbf18eae57', '389b3c10-e4d4-4d71-922c-57e1529fdcd0', 'ef801cd9-87fe-48c4-91ed-3d1a8908e73d'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:14:21 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7d50b04e-7119-4fe7-9b5f-2b98be36e30f tempest-VolumesSnapshotListTestJSON-1670634772 None] Delete snapshot completed successfully.
Nov 05 15:14:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7d50b04e-7119-4fe7-9b5f-2b98be36e30f tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "cinder-3eece887-089f-4093-996d-4fa4c85068a9-delete_snapshot" released by "delete_snapshot" :: held 2.933s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cf35f2c1-e815-444d-b42a-7c4e6090ffcc tempest-VolumesSnapshotListTestJSON-1670634772 None] Acquiring lock "cinder-b0371068-8a5a-4dcd-a7fd-2f83ff091cb5-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cf35f2c1-e815-444d-b42a-7c4e6090ffcc tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "cinder-b0371068-8a5a-4dcd-a7fd-2f83ff091cb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cf35f2c1-e815-444d-b42a-7c4e6090ffcc tempest-VolumesSnapshotListTestJSON-1670634772 None] Acquiring lock "cinder-quobyte-f115c8be-cc06-453f-9db6-a0988bf97661" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cf35f2c1-e815-444d-b42a-7c4e6090ffcc tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "cinder-quobyte-f115c8be-cc06-453f-9db6-a0988bf97661" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cf35f2c1-e815-444d-b42a-7c4e6090ffcc tempest-VolumesSnapshotListTestJSON-1670634772 None] Acquiring lock "cinder-quobyte-b0371068-8a5a-4dcd-a7fd-2f83ff091cb5" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cf35f2c1-e815-444d-b42a-7c4e6090ffcc tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "cinder-quobyte-b0371068-8a5a-4dcd-a7fd-2f83ff091cb5" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-cf35f2c1-e815-444d-b42a-7c4e6090ffcc tempest-VolumesSnapshotListTestJSON-1670634772 None] Deleting offline snapshot b0371068-8a5a-4dcd-a7fd-2f83ff091cb5 of volume f115c8be-cc06-453f-9db6-a0988bf97661 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:14:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-cf35f2c1-e815-444d-b42a-7c4e6090ffcc tempest-VolumesSnapshotListTestJSON-1670634772 None] snapshot_file for this snap is: volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:14:21 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43f113d-fe24-4830-acc5-4272f207d554]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf35f2c1-e815-444d-b42a-7c4e6090ffcc tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:21 devstack sudo[100272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5
Nov 05 15:14:21 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:22 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf35f2c1-e815-444d-b42a-7c4e6090ffcc tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5" returned: 0 in 0.544s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-cf35f2c1-e815-444d-b42a-7c4e6090ffcc tempest-VolumesSnapshotListTestJSON-1670634772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f115c8be-cc06-453f-9db6-a0988bf97661(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:14:22 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb05258-272e-44bd-888a-7657547d4142]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf35f2c1-e815-444d-b42a-7c4e6090ffcc tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:22 devstack sudo[100278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661
Nov 05 15:14:22 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:22 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-f18e678b-da24-40bf-b9d7-14eb944a4ce1 req-f9030637-be95-4352-99f3-c39699081ff6 tempest-AttachVolumeTestJSON-2065852907 None] Terminate volume connection completed successfully.
Nov 05 15:14:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-f18e678b-da24-40bf-b9d7-14eb944a4ce1 req-f9030637-be95-4352-99f3-c39699081ff6 tempest-AttachVolumeTestJSON-2065852907 None] Deleting attachment 95bf1ccc-18d2-45f5-be09-2fc0bdf1b3ad. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 15:14:22 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf35f2c1-e815-444d-b42a-7c4e6090ffcc tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661" returned: 0 in 0.533s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf35f2c1-e815-444d-b42a-7c4e6090ffcc tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:22 devstack sudo[100286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5
Nov 05 15:14:22 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:23 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf35f2c1-e815-444d-b42a-7c4e6090ffcc tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5" returned: 0 in 0.461s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf35f2c1-e815-444d-b42a-7c4e6090ffcc tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:23 devstack sudo[100292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5
Nov 05 15:14:23 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:23 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf35f2c1-e815-444d-b42a-7c4e6090ffcc tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661.b0371068-8a5a-4dcd-a7fd-2f83ff091cb5" returned: 0 in 0.486s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cf35f2c1-e815-444d-b42a-7c4e6090ffcc tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "cinder-quobyte-b0371068-8a5a-4dcd-a7fd-2f83ff091cb5" released by "_delete_snapshot" :: held 2.214s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cf35f2c1-e815-444d-b42a-7c4e6090ffcc tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "cinder-quobyte-f115c8be-cc06-453f-9db6-a0988bf97661" released by "delete_snapshot" :: held 2.261s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:24 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-cf35f2c1-e815-444d-b42a-7c4e6090ffcc tempest-VolumesSnapshotListTestJSON-1670634772 None] Created reservations ['d9623dc4-5955-4b0a-bb71-f6069b3b6fa8', 'b997bb65-c275-4c0d-8ef0-4f62f33f674f', '4b4df2eb-2ffe-4d24-9795-fb78a034fd89', 'd222aa65-7077-4c2a-b342-e681b704fbee'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:14:24 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-cf35f2c1-e815-444d-b42a-7c4e6090ffcc tempest-VolumesSnapshotListTestJSON-1670634772 None] Delete snapshot completed successfully.
Nov 05 15:14:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cf35f2c1-e815-444d-b42a-7c4e6090ffcc tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "cinder-b0371068-8a5a-4dcd-a7fd-2f83ff091cb5-delete_snapshot" released by "delete_snapshot" :: held 2.507s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:24 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-7ff6ebfd-df3d-4883-b4c1-445f2a8c63a7 req-66e2031b-6d1f-4a07-bcf5-bdb38201a415 tempest-AttachVolumeTestJSON-2065852907 None] Terminate volume connection completed successfully.
Nov 05 15:14:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-7ff6ebfd-df3d-4883-b4c1-445f2a8c63a7 req-66e2031b-6d1f-4a07-bcf5-bdb38201a415 tempest-AttachVolumeTestJSON-2065852907 None] Deleting attachment 34a5f612-9ce2-4473-9019-4a0140ca5843. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 15:14:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-256daaa9-54d9-4359-a7d2-144fd3404de6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Acquiring lock "cinder-f115c8be-cc06-453f-9db6-a0988bf97661-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-256daaa9-54d9-4359-a7d2-144fd3404de6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "cinder-f115c8be-cc06-453f-9db6-a0988bf97661-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-256daaa9-54d9-4359-a7d2-144fd3404de6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Acquiring lock "cinder-quobyte-f115c8be-cc06-453f-9db6-a0988bf97661" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-256daaa9-54d9-4359-a7d2-144fd3404de6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "cinder-quobyte-f115c8be-cc06-453f-9db6-a0988bf97661" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:25 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4fb623-0130-406f-9c7b-c4da131820ca]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-256daaa9-54d9-4359-a7d2-144fd3404de6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:25 devstack sudo[100322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661
Nov 05 15:14:25 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:25 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-256daaa9-54d9-4359-a7d2-144fd3404de6 tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661" returned: 0 in 0.605s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-256daaa9-54d9-4359-a7d2-144fd3404de6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:25 devstack sudo[100327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661
Nov 05 15:14:25 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:26 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-256daaa9-54d9-4359-a7d2-144fd3404de6 tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f115c8be-cc06-453f-9db6-a0988bf97661" returned: 0 in 0.283s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-256daaa9-54d9-4359-a7d2-144fd3404de6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "cinder-quobyte-f115c8be-cc06-453f-9db6-a0988bf97661" released by "delete_volume" :: held 0.998s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:26 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-256daaa9-54d9-4359-a7d2-144fd3404de6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Created reservations ['91ab9d06-b53d-432d-b216-c9212103e414', '5fe2427f-e934-4fb9-86dc-cb900b31db9b', '8990802c-9492-4280-a5d5-4ea0d08660bb', 'd96117cf-eae0-4ae4-9663-8d7a370fc7aa'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:14:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-256daaa9-54d9-4359-a7d2-144fd3404de6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-256daaa9-54d9-4359-a7d2-144fd3404de6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-256daaa9-54d9-4359-a7d2-144fd3404de6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:14:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-256daaa9-54d9-4359-a7d2-144fd3404de6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:14:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-256daaa9-54d9-4359-a7d2-144fd3404de6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-256daaa9-54d9-4359-a7d2-144fd3404de6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:26 devstack sudo[100349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:14:26 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:26 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-256daaa9-54d9-4359-a7d2-144fd3404de6 tempest-VolumesSnapshotListTestJSON-1670634772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.296s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:26 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-256daaa9-54d9-4359-a7d2-144fd3404de6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:14:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-256daaa9-54d9-4359-a7d2-144fd3404de6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Deleted volume successfully.
Nov 05 15:14:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-256daaa9-54d9-4359-a7d2-144fd3404de6 tempest-VolumesSnapshotListTestJSON-1670634772 None] Lock "cinder-f115c8be-cc06-453f-9db6-a0988bf97661-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:36 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=53,cinder:UPDATE=55,cinder:INSERT=14,cinder:DELETE=2 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:14:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5746b26e-e132-4ae2-b03f-62963e9aa851 tempest-AttachVolumeTestJSON-2065852907 None] Acquiring lock "cinder-5f40ddea-1476-4372-8112-4bf339b21f95-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5746b26e-e132-4ae2-b03f-62963e9aa851 tempest-AttachVolumeTestJSON-2065852907 None] Lock "cinder-5f40ddea-1476-4372-8112-4bf339b21f95-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5746b26e-e132-4ae2-b03f-62963e9aa851 tempest-AttachVolumeTestJSON-2065852907 None] Acquiring lock "cinder-quobyte-5f40ddea-1476-4372-8112-4bf339b21f95" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5746b26e-e132-4ae2-b03f-62963e9aa851 tempest-AttachVolumeTestJSON-2065852907 None] Lock "cinder-quobyte-5f40ddea-1476-4372-8112-4bf339b21f95" acquired by "delete_volume" :: waited 0.024s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:36 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a3eac9-d8cf-4c6b-b818-df7b531c9f6b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5746b26e-e132-4ae2-b03f-62963e9aa851 tempest-AttachVolumeTestJSON-2065852907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5f40ddea-1476-4372-8112-4bf339b21f95 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:36 devstack sudo[100359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5f40ddea-1476-4372-8112-4bf339b21f95
Nov 05 15:14:36 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:37 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5746b26e-e132-4ae2-b03f-62963e9aa851 tempest-AttachVolumeTestJSON-2065852907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5f40ddea-1476-4372-8112-4bf339b21f95" returned: 0 in 0.447s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5746b26e-e132-4ae2-b03f-62963e9aa851 tempest-AttachVolumeTestJSON-2065852907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5f40ddea-1476-4372-8112-4bf339b21f95 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:37 devstack sudo[100364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5f40ddea-1476-4372-8112-4bf339b21f95
Nov 05 15:14:37 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:37 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5746b26e-e132-4ae2-b03f-62963e9aa851 tempest-AttachVolumeTestJSON-2065852907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5f40ddea-1476-4372-8112-4bf339b21f95" returned: 0 in 0.284s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:37 devstack sudo[100367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:14:37 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5746b26e-e132-4ae2-b03f-62963e9aa851 tempest-AttachVolumeTestJSON-2065852907 None] Lock "cinder-quobyte-5f40ddea-1476-4372-8112-4bf339b21f95" released by "delete_volume" :: held 0.804s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-5746b26e-e132-4ae2-b03f-62963e9aa851 tempest-AttachVolumeTestJSON-2065852907 None] Created reservations ['26e08257-5f4a-48cb-b534-fa7e3419a658', '60d2d264-fdfd-47be-b9a0-0d248e240fd5', 'f4669630-9936-4284-a858-ce6e0e57f3d2', '13047d11-8c07-42ad-8176-f003913b1b7c'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5746b26e-e132-4ae2-b03f-62963e9aa851 tempest-AttachVolumeTestJSON-2065852907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5746b26e-e132-4ae2-b03f-62963e9aa851 tempest-AttachVolumeTestJSON-2065852907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5746b26e-e132-4ae2-b03f-62963e9aa851 tempest-AttachVolumeTestJSON-2065852907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5746b26e-e132-4ae2-b03f-62963e9aa851 tempest-AttachVolumeTestJSON-2065852907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5746b26e-e132-4ae2-b03f-62963e9aa851 tempest-AttachVolumeTestJSON-2065852907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5746b26e-e132-4ae2-b03f-62963e9aa851 tempest-AttachVolumeTestJSON-2065852907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:37 devstack sudo[100370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:14:37 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:37 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.395s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread info: [<_MainThread(MainThread, started 136317437956224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136317326340928)>, <Thread(Thread-3 (stat_writer), started daemon 136317326487936)>, <Thread(Rabbit-heartbeat, started daemon 136317321464000)>, <Thread(Thread-5 (_runner), started daemon 136317321550592)>, <Thread(Thread-7 (_runner), started daemon 136317321658496)>, <Thread(fd_logger, started daemon 136317319612992)>, <Thread(privsep_reader, started daemon 136317319622400)>, <Thread(tpool_thread_0, started daemon 136317310928576)>, <Thread(tpool_thread_1, started daemon 136317302535872)>, <Thread(tpool_thread_2, started daemon 136317294143168)>, <Thread(tpool_thread_3, started daemon 136317285750464)>, <Thread(tpool_thread_4, started daemon 136317277357760)>, <Thread(tpool_thread_5, started daemon 136317268965056)>, <Thread(tpool_thread_6, started daemon 136317260572352)>, <Thread(tpool_thread_7, started daemon 136317252179648)>, <Thread(tpool_thread_8, started daemon 136317243786944)>, <Thread(tpool_thread_9, started daemon 136317235394240)>, <Thread(tpool_thread_10, started daemon 136317227001536)>, <Thread(tpool_thread_11, started daemon 136317218608832)>, <Thread(tpool_thread_12, started daemon 136317210216128)>, <Thread(tpool_thread_13, started daemon 136317201807040)>, <Thread(tpool_thread_14, started daemon 136317193397952)>, <Thread(tpool_thread_15, started daemon 136317184988864)>, <Thread(tpool_thread_16, started daemon 136317176579776)>, <Thread(tpool_thread_17, started daemon 136317168170688)>, <Thread(tpool_thread_18, started daemon 136317159761600)>, <Thread(tpool_thread_19, started daemon 136317151352512)>] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7972870d-5a9c-4d89-8b3d-c54356c7c9c7 tempest-AttachVolumeTestJSON-2065852907 None] Acquiring lock "cinder-f834f77f-fcaf-4887-b9c6-09e5e84c4b70-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7972870d-5a9c-4d89-8b3d-c54356c7c9c7 tempest-AttachVolumeTestJSON-2065852907 None] Lock "cinder-f834f77f-fcaf-4887-b9c6-09e5e84c4b70-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7972870d-5a9c-4d89-8b3d-c54356c7c9c7 tempest-AttachVolumeTestJSON-2065852907 None] Acquiring lock "cinder-quobyte-f834f77f-fcaf-4887-b9c6-09e5e84c4b70" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7972870d-5a9c-4d89-8b3d-c54356c7c9c7 tempest-AttachVolumeTestJSON-2065852907 None] Lock "cinder-quobyte-f834f77f-fcaf-4887-b9c6-09e5e84c4b70" acquired by "delete_volume" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:38 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59a0490-ab31-4125-a961-e69b6f9ea451]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7972870d-5a9c-4d89-8b3d-c54356c7c9c7 tempest-AttachVolumeTestJSON-2065852907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f834f77f-fcaf-4887-b9c6-09e5e84c4b70 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:38 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5746b26e-e132-4ae2-b03f-62963e9aa851 tempest-AttachVolumeTestJSON-2065852907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.409s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:38 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-5746b26e-e132-4ae2-b03f-62963e9aa851 tempest-AttachVolumeTestJSON-2065852907 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:14:38 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5746b26e-e132-4ae2-b03f-62963e9aa851 tempest-AttachVolumeTestJSON-2065852907 None] Deleted volume successfully.
Nov 05 15:14:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5746b26e-e132-4ae2-b03f-62963e9aa851 tempest-AttachVolumeTestJSON-2065852907 None] Lock "cinder-5f40ddea-1476-4372-8112-4bf339b21f95-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:38 devstack sudo[100372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f834f77f-fcaf-4887-b9c6-09e5e84c4b70
Nov 05 15:14:38 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:38 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7972870d-5a9c-4d89-8b3d-c54356c7c9c7 tempest-AttachVolumeTestJSON-2065852907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f834f77f-fcaf-4887-b9c6-09e5e84c4b70" returned: 0 in 0.510s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7972870d-5a9c-4d89-8b3d-c54356c7c9c7 tempest-AttachVolumeTestJSON-2065852907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f834f77f-fcaf-4887-b9c6-09e5e84c4b70 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:38 devstack sudo[100378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f834f77f-fcaf-4887-b9c6-09e5e84c4b70
Nov 05 15:14:38 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:38 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7972870d-5a9c-4d89-8b3d-c54356c7c9c7 tempest-AttachVolumeTestJSON-2065852907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f834f77f-fcaf-4887-b9c6-09e5e84c4b70" returned: 0 in 0.324s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7972870d-5a9c-4d89-8b3d-c54356c7c9c7 tempest-AttachVolumeTestJSON-2065852907 None] Lock "cinder-quobyte-f834f77f-fcaf-4887-b9c6-09e5e84c4b70" released by "delete_volume" :: held 0.906s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:38 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-7972870d-5a9c-4d89-8b3d-c54356c7c9c7 tempest-AttachVolumeTestJSON-2065852907 None] Created reservations ['6c84a440-f2cf-4882-a104-63f38b8945c0', '4612862e-6240-46d1-ac8f-5c2dfb0df20f', 'b5cc9f17-b366-4b4a-8907-7f995e4919b2', 'a15b0bff-a53d-41d2-9204-172f38ce1dff'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:14:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7972870d-5a9c-4d89-8b3d-c54356c7c9c7 tempest-AttachVolumeTestJSON-2065852907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7972870d-5a9c-4d89-8b3d-c54356c7c9c7 tempest-AttachVolumeTestJSON-2065852907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7972870d-5a9c-4d89-8b3d-c54356c7c9c7 tempest-AttachVolumeTestJSON-2065852907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:14:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7972870d-5a9c-4d89-8b3d-c54356c7c9c7 tempest-AttachVolumeTestJSON-2065852907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:14:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7972870d-5a9c-4d89-8b3d-c54356c7c9c7 tempest-AttachVolumeTestJSON-2065852907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7972870d-5a9c-4d89-8b3d-c54356c7c9c7 tempest-AttachVolumeTestJSON-2065852907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:39 devstack sudo[100382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:14:39 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:39 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7972870d-5a9c-4d89-8b3d-c54356c7c9c7 tempest-AttachVolumeTestJSON-2065852907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.267s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:39 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-7972870d-5a9c-4d89-8b3d-c54356c7c9c7 tempest-AttachVolumeTestJSON-2065852907 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:14:39 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7972870d-5a9c-4d89-8b3d-c54356c7c9c7 tempest-AttachVolumeTestJSON-2065852907 None] Deleted volume successfully.
Nov 05 15:14:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7972870d-5a9c-4d89-8b3d-c54356c7c9c7 tempest-AttachVolumeTestJSON-2065852907 None] Lock "cinder-f834f77f-fcaf-4887-b9c6-09e5e84c4b70-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cecc7225-9c7c-49b6-b174-00463ba78dab tempest-AttachVolumeTestJSON-2065852907 None] Acquiring lock "cinder-9190ad5e-d8a4-4a16-8b50-96b59ebcb793-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cecc7225-9c7c-49b6-b174-00463ba78dab tempest-AttachVolumeTestJSON-2065852907 None] Lock "cinder-9190ad5e-d8a4-4a16-8b50-96b59ebcb793-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cecc7225-9c7c-49b6-b174-00463ba78dab tempest-AttachVolumeTestJSON-2065852907 None] Acquiring lock "cinder-quobyte-9190ad5e-d8a4-4a16-8b50-96b59ebcb793" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:14:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cecc7225-9c7c-49b6-b174-00463ba78dab tempest-AttachVolumeTestJSON-2065852907 None] Lock "cinder-quobyte-9190ad5e-d8a4-4a16-8b50-96b59ebcb793" acquired by "delete_volume" :: waited 0.028s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:14:40 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ccf958-df1a-4295-8c41-ce6151b5dac5]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cecc7225-9c7c-49b6-b174-00463ba78dab tempest-AttachVolumeTestJSON-2065852907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9190ad5e-d8a4-4a16-8b50-96b59ebcb793 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:40 devstack sudo[100385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9190ad5e-d8a4-4a16-8b50-96b59ebcb793
Nov 05 15:14:40 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:41 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cecc7225-9c7c-49b6-b174-00463ba78dab tempest-AttachVolumeTestJSON-2065852907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9190ad5e-d8a4-4a16-8b50-96b59ebcb793" returned: 0 in 0.510s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cecc7225-9c7c-49b6-b174-00463ba78dab tempest-AttachVolumeTestJSON-2065852907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9190ad5e-d8a4-4a16-8b50-96b59ebcb793 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:41 devstack sudo[100390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9190ad5e-d8a4-4a16-8b50-96b59ebcb793
Nov 05 15:14:41 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:41 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cecc7225-9c7c-49b6-b174-00463ba78dab tempest-AttachVolumeTestJSON-2065852907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-9190ad5e-d8a4-4a16-8b50-96b59ebcb793" returned: 0 in 0.339s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cecc7225-9c7c-49b6-b174-00463ba78dab tempest-AttachVolumeTestJSON-2065852907 None] Lock "cinder-quobyte-9190ad5e-d8a4-4a16-8b50-96b59ebcb793" released by "delete_volume" :: held 0.923s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:41 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-cecc7225-9c7c-49b6-b174-00463ba78dab tempest-AttachVolumeTestJSON-2065852907 None] Created reservations ['606eb6b6-1934-461f-b89d-798a75ff4f11', '0b8be013-8c29-48d9-a4f4-6fedac2dedc6', 'dbe21bd6-99c8-4d22-afb6-6393349f7a71', '2a5bc8e0-4b35-40e4-8ba9-97439a46bbd7'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:14:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cecc7225-9c7c-49b6-b174-00463ba78dab tempest-AttachVolumeTestJSON-2065852907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cecc7225-9c7c-49b6-b174-00463ba78dab tempest-AttachVolumeTestJSON-2065852907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cecc7225-9c7c-49b6-b174-00463ba78dab tempest-AttachVolumeTestJSON-2065852907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:14:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cecc7225-9c7c-49b6-b174-00463ba78dab tempest-AttachVolumeTestJSON-2065852907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:14:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cecc7225-9c7c-49b6-b174-00463ba78dab tempest-AttachVolumeTestJSON-2065852907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cecc7225-9c7c-49b6-b174-00463ba78dab tempest-AttachVolumeTestJSON-2065852907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:41 devstack sudo[100393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:14:41 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:42 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cecc7225-9c7c-49b6-b174-00463ba78dab tempest-AttachVolumeTestJSON-2065852907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.376s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:42 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-cecc7225-9c7c-49b6-b174-00463ba78dab tempest-AttachVolumeTestJSON-2065852907 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:14:42 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-cecc7225-9c7c-49b6-b174-00463ba78dab tempest-AttachVolumeTestJSON-2065852907 None] Deleted volume successfully.
Nov 05 15:14:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cecc7225-9c7c-49b6-b174-00463ba78dab tempest-AttachVolumeTestJSON-2065852907 None] Lock "cinder-9190ad5e-d8a4-4a16-8b50-96b59ebcb793-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Flow 'volume_create_manager' (9a1d1bf2-1265-4e82-a27c-e7ebc19b4047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d2966b-5c6a-4652-8c4f-21744ae2c347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d2966b-5c6a-4652-8c4f-21744ae2c347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-213022072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a8bd2aeefe4137a57a7180bcd4a5e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:45Z,use_quota=True,user_id='a8e7725070d048adbd89ad0cbb5cc3eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03632949-3d34-4951-b7b4-b76aa8cb6593),volume_type_id=03632949-3d34-4951-b7b4-b76aa8cb6593)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20978b26-e617-49ee-81f6-753b59a47970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20978b26-e617-49ee-81f6-753b59a47970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7710bec2-1210-4981-91f2-c1467dee1b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7710bec2-1210-4981-91f2-c1467dee1b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01', 'volume_name': 'volume-fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b35dea-7753-41f2-b660-41aade218804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b35dea-7753-41f2-b660-41aade218804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24e6a7e1-465b-4935-8090-c741baf4417c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:45 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Volume fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01', 'volume_size': 1}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-213022072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a8bd2aeefe4137a57a7180bcd4a5e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:45Z,use_quota=True,user_id='a8e7725070d048adbd89ad0cbb5cc3eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03632949-3d34-4951-b7b4-b76aa8cb6593),volume_type_id=03632949-3d34-4951-b7b4-b76aa8cb6593)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Creating volume fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:14:45 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:45 devstack sudo[100397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01 1073741824
Nov 05 15:14:45 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Flow 'volume_create_manager' (08d1e568-08b8-4844-a5c2-729904659ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766106f9-b69b-4c7c-9c78-f630c7bc86eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766106f9-b69b-4c7c-9c78-f630c7bc86eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1690276546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0ae42f-7eca-4150-a9bc-c4be12414c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a8bd2aeefe4137a57a7180bcd4a5e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:46Z,use_quota=True,user_id='a8e7725070d048adbd89ad0cbb5cc3eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80e0a12c-80b4-46a1-ad38-e6c77e13c8bf),volume_type_id=80e0a12c-80b4-46a1-ad38-e6c77e13c8bf)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44163ca8-650d-4403-876c-d33c678565c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44163ca8-650d-4403-876c-d33c678565c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587439f1-c6ed-4f0b-a276-ea3dd67832d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587439f1-c6ed-4f0b-a276-ea3dd67832d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a0ae42f-7eca-4150-a9bc-c4be12414c53', 'volume_name': 'volume-8a0ae42f-7eca-4150-a9bc-c4be12414c53', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbcbcca-5bc6-4465-970f-05a3d38cf4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbcbcca-5bc6-4465-970f-05a3d38cf4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5323c3-8fa7-40b1-afb0-5c9c10ee6194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:45 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Volume 8a0ae42f-7eca-4150-a9bc-c4be12414c53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a0ae42f-7eca-4150-a9bc-c4be12414c53', 'volume_size': 1}
Nov 05 15:14:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:46 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01 1073741824" returned: 0 in 0.738s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:46 devstack sudo[100403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01
Nov 05 15:14:46 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:46 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01" returned: 0 in 0.415s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.646s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1690276546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0ae42f-7eca-4150-a9bc-c4be12414c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a8bd2aeefe4137a57a7180bcd4a5e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:46Z,use_quota=True,user_id='a8e7725070d048adbd89ad0cbb5cc3eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80e0a12c-80b4-46a1-ad38-e6c77e13c8bf),volume_type_id=80e0a12c-80b4-46a1-ad38-e6c77e13c8bf)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Creating volume 8a0ae42f-7eca-4150-a9bc-c4be12414c53 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:14:46 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8a0ae42f-7eca-4150-a9bc-c4be12414c53 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:46 devstack sudo[100406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8a0ae42f-7eca-4150-a9bc-c4be12414c53 1073741824
Nov 05 15:14:46 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24e6a7e1-465b-4935-8090-c741baf4417c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b31494-abc2-4fd0-b3a5-4e99abc71d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:46 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Volume volume-fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01 (fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01): created successfully
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b31494-abc2-4fd0-b3a5-4e99abc71d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Flow 'volume_create_manager' (9a1d1bf2-1265-4e82-a27c-e7ebc19b4047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:14:46 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-8ae5f43b-161b-47ff-9b9d-f0ffbbfdf15f tempest-TestInstancesWithCinderVolumes-1687340720 None] Created volume successfully.
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Flow 'volume_create_manager' (53548d9a-dd68-42b3-a5f7-d9da864a198d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e39f0e9-8b8a-4a3e-997f-5cb0c0ab5787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e39f0e9-8b8a-4a3e-997f-5cb0c0ab5787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1363481053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa2c572b-d9c7-4bcd-9109-9a7ff44a864c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a8bd2aeefe4137a57a7180bcd4a5e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:47Z,use_quota=True,user_id='a8e7725070d048adbd89ad0cbb5cc3eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be3d8411-ac87-4e80-a00f-c6cc87b3cc1a),volume_type_id=be3d8411-ac87-4e80-a00f-c6cc87b3cc1a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c419143c-2a02-48ba-9235-566ba614e1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c419143c-2a02-48ba-9235-566ba614e1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d928a3-a920-4c27-a328-1730d0ff9dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:46 devstack cinder-volume[87150]: DEBUG cinder.image.glance [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Creating Keystone auth plugin from conf {{(pid=87150) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 15:14:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d928a3-a920-4c27-a328-1730d0ff9dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aa2c572b-d9c7-4bcd-9109-9a7ff44a864c', 'volume_name': 'volume-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c', 'volume_size': 1, 'image_id': '1fd318ee-ec96-4666-98ce-c97d217f7946', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fd318ee-ec96-4666-98ce-c97d217f7946', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1732840399', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01a8bd2aeefe4137a57a7180bcd4a5e2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fd318ee-ec96-4666-98ce-c97d217f7946', 'created_at': datetime.datetime(2026, 11, 5, 14, 14, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 14, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fd318ee-ec96-4666-98ce-c97d217f7946/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfad92fd310>}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7b0a3a-765e-4f26-8252-4fc279d2172b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7b0a3a-765e-4f26-8252-4fc279d2172b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a4101c9-5cdd-4f27-bb8a-b73f311d0411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:47 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Volume aa2c572b-d9c7-4bcd-9109-9a7ff44a864c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c', 'volume_size': 1, 'image_id': '1fd318ee-ec96-4666-98ce-c97d217f7946', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fd318ee-ec96-4666-98ce-c97d217f7946', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1732840399', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01a8bd2aeefe4137a57a7180bcd4a5e2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fd318ee-ec96-4666-98ce-c97d217f7946', 'created_at': datetime.datetime(2026, 11, 5, 14, 14, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 14, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fd318ee-ec96-4666-98ce-c97d217f7946/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfad92fd310>}
Nov 05 15:14:47 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Trying to clone aa2c572b-d9c7-4bcd-9109-9a7ff44a864c from image 1fd318ee-ec96-4666-98ce-c97d217f7946 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1fd318ee-ec96-4666-98ce-c97d217f7946', 'metadata': {}}]). {{(pid=87150) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 15:14:47 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8a0ae42f-7eca-4150-a9bc-c4be12414c53 1073741824" returned: 0 in 0.665s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8a0ae42f-7eca-4150-a9bc-c4be12414c53 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:47 devstack sudo[100413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8a0ae42f-7eca-4150-a9bc-c4be12414c53
Nov 05 15:14:47 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:47 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8a0ae42f-7eca-4150-a9bc-c4be12414c53" returned: 0 in 0.382s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:14:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5323c3-8fa7-40b1-afb0-5c9c10ee6194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a0ae42f-7eca-4150-a9bc-c4be12414c53', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db6cd43-6f0a-452a-84c4-01e4530bed8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:47 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Volume volume-8a0ae42f-7eca-4150-a9bc-c4be12414c53 (8a0ae42f-7eca-4150-a9bc-c4be12414c53): created successfully
Nov 05 15:14:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db6cd43-6f0a-452a-84c4-01e4530bed8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Flow 'volume_create_manager' (08d1e568-08b8-4844-a5c2-729904659ca5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:14:47 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a69ed7ec-1337-46c3-8d64-8a1fb9a3ce88 tempest-TestInstancesWithCinderVolumes-1687340720 None] Created volume successfully.
Nov 05 15:14:51 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1fd318ee-ec96-4666-98ce-c97d217f7946_l4xz3j1ddevstack@QuobyteHD, size 20.69 MB, duration 4.43 sec {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 15:14:51 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Image download 20.69 MB at 4.67 MB/s
Nov 05 15:14:51 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e206f5-5053-4f68-8f45-c2560a23d92a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fd318ee-ec96-4666-98ce-c97d217f7946_l4xz3j1ddevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:51 devstack sudo[100418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fd318ee-ec96-4666-98ce-c97d217f7946_l4xz3j1ddevstack@QuobyteHD
Nov 05 15:14:51 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:52 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fd318ee-ec96-4666-98ce-c97d217f7946_l4xz3j1ddevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:52 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Temporary image 1fd318ee-ec96-4666-98ce-c97d217f7946 is fetched for user a8e7725070d048adbd89ad0cbb5cc3eb. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 15:14:52 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[591947c3-8b45-43f0-8943-0c1a80116e93]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fd318ee-ec96-4666-98ce-c97d217f7946_l4xz3j1ddevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:52 devstack sudo[100424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fd318ee-ec96-4666-98ce-c97d217f7946_l4xz3j1ddevstack@QuobyteHD
Nov 05 15:14:52 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:52 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fd318ee-ec96-4666-98ce-c97d217f7946_l4xz3j1ddevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1363481053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa2c572b-d9c7-4bcd-9109-9a7ff44a864c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a8bd2aeefe4137a57a7180bcd4a5e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:47Z,use_quota=True,user_id='a8e7725070d048adbd89ad0cbb5cc3eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be3d8411-ac87-4e80-a00f-c6cc87b3cc1a),volume_type_id=be3d8411-ac87-4e80-a00f-c6cc87b3cc1a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:14:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Creating volume aa2c572b-d9c7-4bcd-9109-9a7ff44a864c {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:14:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:14:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:14:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:14:52 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:14:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:52 devstack sudo[100430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c 1073741824
Nov 05 15:14:52 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:53 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c 1073741824" returned: 0 in 0.545s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:53 devstack sudo[100435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c
Nov 05 15:14:53 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:53 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c" returned: 0 in 0.308s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:14:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:53 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Attempting download of 1fd318ee-ec96-4666-98ce-c97d217f7946 ((None, [{'url': 'file:///opt/stack/data/glance/images/1fd318ee-ec96-4666-98ce-c97d217f7946', 'metadata': {}}])) to volume aa2c572b-d9c7-4bcd-9109-9a7ff44a864c. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 15:14:53 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[513b14dd-2fc9-43ed-83cf-906cb506e68a]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fd318ee-ec96-4666-98ce-c97d217f7946_yp_w8sls {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:53 devstack sudo[100438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fd318ee-ec96-4666-98ce-c97d217f7946_yp_w8sls
Nov 05 15:14:53 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:53 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fd318ee-ec96-4666-98ce-c97d217f7946_yp_w8sls" returned: 0 in 0.382s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fd318ee-ec96-4666-98ce-c97d217f7946_yp_w8sls {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:54 devstack sudo[100442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fd318ee-ec96-4666-98ce-c97d217f7946_yp_w8sls
Nov 05 15:14:54 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:54 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fd318ee-ec96-4666-98ce-c97d217f7946_yp_w8sls" returned: 1 in 0.401s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fd318ee-ec96-4666-98ce-c97d217f7946_yp_w8sls' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 15:14:54 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[43190c58-73e3-4832-ad3c-318940ec8f88]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fd318ee-ec96-4666-98ce-c97d217f7946_l4xz3j1ddevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:54 devstack sudo[100446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fd318ee-ec96-4666-98ce-c97d217f7946_l4xz3j1ddevstack@QuobyteHD
Nov 05 15:14:54 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:54 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fd318ee-ec96-4666-98ce-c97d217f7946_l4xz3j1ddevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:54 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] 1fd318ee-ec96-4666-98ce-c97d217f7946 was qcow2, converting to qcow2 {{(pid=87150) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 15:14:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fd318ee-ec96-4666-98ce-c97d217f7946_l4xz3j1ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:54 devstack sudo[100451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fd318ee-ec96-4666-98ce-c97d217f7946_l4xz3j1ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c
Nov 05 15:14:54 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:56 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:14:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Flow 'volume_create_manager' (48d94292-e7c8-428f-b575-3b28af802be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:14:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed2a035-ded9-4c5a-abb5-1dbf8ac39038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed2a035-ded9-4c5a-abb5-1dbf8ac39038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-186333922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6451e404-e6cd-4d5b-89f8-5d2cd825a9c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50b0ffb917ec42d9b0cd5217752f7b50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:56Z,use_quota=True,user_id='be04f404385f4ff89f95a4d043a40d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bff863f5-1385-40ac-b203-ea192f158410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bff863f5-1385-40ac-b203-ea192f158410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5224842-719e-4320-97fa-ac7e6a5de203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5224842-719e-4320-97fa-ac7e6a5de203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6451e404-e6cd-4d5b-89f8-5d2cd825a9c1', 'volume_name': 'volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36d83b2-32cb-4151-99f7-668b7e816a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36d83b2-32cb-4151-99f7-668b7e816a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c504d8-ad21-43b2-a916-42ea145a6507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:56 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Volume 6451e404-e6cd-4d5b-89f8-5d2cd825a9c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1', 'volume_size': 1}
Nov 05 15:14:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-186333922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6451e404-e6cd-4d5b-89f8-5d2cd825a9c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50b0ffb917ec42d9b0cd5217752f7b50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:56Z,use_quota=True,user_id='be04f404385f4ff89f95a4d043a40d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:14:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Creating volume 6451e404-e6cd-4d5b-89f8-5d2cd825a9c1 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:14:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:14:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:14:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:14:56 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:14:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:56 devstack sudo[100459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1 1073741824
Nov 05 15:14:56 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:57 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1 1073741824" returned: 0 in 0.781s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:57 devstack sudo[100466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1
Nov 05 15:14:57 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:57 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fd318ee-ec96-4666-98ce-c97d217f7946_l4xz3j1ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c" returned: 0 in 2.852s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:57 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1fd318ee-ec96-4666-98ce-c97d217f7946_l4xz3j1ddevstack@QuobyteHD, size 112.00 MB, duration 2.85 sec, destination /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:14:57 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Converted 112.00 MB image at 39.25 MB/s
Nov 05 15:14:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:57 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1" returned: 0 in 0.356s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:14:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:14:57 devstack sudo[100469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c 1G
Nov 05 15:14:57 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c504d8-ad21-43b2-a916-42ea145a6507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2afa80-f866-4980-8640-ac1df7d4f339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:57 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Volume volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1 (6451e404-e6cd-4d5b-89f8-5d2cd825a9c1): created successfully
Nov 05 15:14:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2afa80-f866-4980-8640-ac1df7d4f339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Flow 'volume_create_manager' (48d94292-e7c8-428f-b575-3b28af802be2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:14:57 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7b00e1af-8347-43d2-97fe-d5d44b0c6c45 tempest-SnapshotDependencyTests-415004524 None] Created volume successfully.
Nov 05 15:14:58 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c 1G" returned: 0 in 0.443s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:58 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Downloaded image 1fd318ee-ec96-4666-98ce-c97d217f7946 ((None, [{'url': 'file:///opt/stack/data/glance/images/1fd318ee-ec96-4666-98ce-c97d217f7946', 'metadata': {}}])) to volume aa2c572b-d9c7-4bcd-9109-9a7ff44a864c successfully. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 15:14:58 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Temporary image 1fd318ee-ec96-4666-98ce-c97d217f7946 for user a8e7725070d048adbd89ad0cbb5cc3eb is deleted. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 15:14:58 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Marking volume aa2c572b-d9c7-4bcd-9109-9a7ff44a864c as bootable. {{(pid=87150) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 15:14:58 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Copying metadata from image 1fd318ee-ec96-4666-98ce-c97d217f7946 to aa2c572b-d9c7-4bcd-9109-9a7ff44a864c. {{(pid=87150) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 15:14:58 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Creating volume glance metadata for volume aa2c572b-d9c7-4bcd-9109-9a7ff44a864c backed by image 1fd318ee-ec96-4666-98ce-c97d217f7946 with: {'image_id': '1fd318ee-ec96-4666-98ce-c97d217f7946', 'image_name': 'tempest-scenario-img--1732840399', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87150) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 15:14:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a4101c9-5cdd-4f27-bb8a-b73f311d0411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c', 'volume_size': 1, 'image_id': '1fd318ee-ec96-4666-98ce-c97d217f7946', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fd318ee-ec96-4666-98ce-c97d217f7946', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1732840399', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01a8bd2aeefe4137a57a7180bcd4a5e2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fd318ee-ec96-4666-98ce-c97d217f7946', 'created_at': datetime.datetime(2026, 11, 5, 14, 14, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 14, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fd318ee-ec96-4666-98ce-c97d217f7946/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfad92fd310>}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b585ba-5f5d-4de3-b07d-1249e025ca57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:14:58 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Volume volume-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c (aa2c572b-d9c7-4bcd-9109-9a7ff44a864c): created successfully
Nov 05 15:14:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b585ba-5f5d-4de3-b07d-1249e025ca57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:14:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Flow 'volume_create_manager' (53548d9a-dd68-42b3-a5f7-d9da864a198d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:14:58 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5e8577b4-3a4d-4807-8616-64a379d1346c tempest-TestInstancesWithCinderVolumes-1687340720 None] Created volume successfully.
Nov 05 15:14:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-59637e9f-4ca2-4b14-8336-543cd4b2853f tempest-SnapshotDependencyTests-415004524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:14:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-59637e9f-4ca2-4b14-8336-543cd4b2853f tempest-SnapshotDependencyTests-415004524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:14:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-59637e9f-4ca2-4b14-8336-543cd4b2853f tempest-SnapshotDependencyTests-415004524 None] Creating offline snapshot 8caf94e0-5d40-4d1f-84dd-06d284ade0af of volume 6451e404-e6cd-4d5b-89f8-5d2cd825a9c1 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:14:58 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7882a0e3-ef55-40eb-bc50-291e25257ea3]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:14:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59637e9f-4ca2-4b14-8336-543cd4b2853f tempest-SnapshotDependencyTests-415004524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:58 devstack sudo[100475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1
Nov 05 15:14:58 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:59 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59637e9f-4ca2-4b14-8336-543cd4b2853f tempest-SnapshotDependencyTests-415004524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1" returned: 0 in 0.686s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59637e9f-4ca2-4b14-8336-543cd4b2853f tempest-SnapshotDependencyTests-415004524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.8caf94e0-5d40-4d1f-84dd-06d284ade0af 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:59 devstack sudo[100482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.8caf94e0-5d40-4d1f-84dd-06d284ade0af 1G
Nov 05 15:14:59 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:14:59 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root
Nov 05 15:14:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59637e9f-4ca2-4b14-8336-543cd4b2853f tempest-SnapshotDependencyTests-415004524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.8caf94e0-5d40-4d1f-84dd-06d284ade0af 1G" returned: 0 in 0.564s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:14:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59637e9f-4ca2-4b14-8336-543cd4b2853f tempest-SnapshotDependencyTests-415004524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.8caf94e0-5d40-4d1f-84dd-06d284ade0af {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:14:59 devstack sudo[100488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.8caf94e0-5d40-4d1f-84dd-06d284ade0af
Nov 05 15:14:59 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:00 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59637e9f-4ca2-4b14-8336-543cd4b2853f tempest-SnapshotDependencyTests-415004524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.8caf94e0-5d40-4d1f-84dd-06d284ade0af" returned: 0 in 0.374s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:00 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-59637e9f-4ca2-4b14-8336-543cd4b2853f tempest-SnapshotDependencyTests-415004524 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.8caf94e0-5d40-4d1f-84dd-06d284ade0af is being set with open permissions: ugo+rw
Nov 05 15:15:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59637e9f-4ca2-4b14-8336-543cd4b2853f tempest-SnapshotDependencyTests-415004524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.8caf94e0-5d40-4d1f-84dd-06d284ade0af {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:00 devstack sudo[100493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.8caf94e0-5d40-4d1f-84dd-06d284ade0af
Nov 05 15:15:00 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:00 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59637e9f-4ca2-4b14-8336-543cd4b2853f tempest-SnapshotDependencyTests-415004524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.8caf94e0-5d40-4d1f-84dd-06d284ade0af" returned: 0 in 0.461s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59637e9f-4ca2-4b14-8336-543cd4b2853f tempest-SnapshotDependencyTests-415004524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:00 devstack sudo[100499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.info
Nov 05 15:15:00 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Flow 'volume_create_manager' (068c87d5-fcc7-462f-b155-53c5a23ddb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f7c3eb6-1a63-4a43-9bf1-7bf05c5ac4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:15:01 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f7c3eb6-1a63-4a43-9bf1-7bf05c5ac4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-712938645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24e2904-0c18-4067-8cf9-66ae175048d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d67c97263152420896d01aae87b8f2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:01Z,use_quota=True,user_id='f8794abc0bbe4a7c9fe4a42e85624dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46aefb75-1615-4d80-ad23-7a23b4809bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46aefb75-1615-4d80-ad23-7a23b4809bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e95630-5c53-4256-b686-84acda012314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e95630-5c53-4256-b686-84acda012314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b24e2904-0c18-4067-8cf9-66ae175048d1', 'volume_name': 'volume-b24e2904-0c18-4067-8cf9-66ae175048d1', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee43ba6-0f05-4441-9b11-4037254d5d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee43ba6-0f05-4441-9b11-4037254d5d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9b9b2b-ca6e-4949-87dd-b083398eb9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:15:01 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Volume b24e2904-0c18-4067-8cf9-66ae175048d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b24e2904-0c18-4067-8cf9-66ae175048d1', 'volume_size': 1}
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59637e9f-4ca2-4b14-8336-543cd4b2853f tempest-SnapshotDependencyTests-415004524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.info" returned: 0 in 0.456s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:01 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-59637e9f-4ca2-4b14-8336-543cd4b2853f tempest-SnapshotDependencyTests-415004524 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.info is being set with open permissions: ugo+rw
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59637e9f-4ca2-4b14-8336-543cd4b2853f tempest-SnapshotDependencyTests-415004524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:01 devstack sudo[100502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.info
Nov 05 15:15:01 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:01 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59637e9f-4ca2-4b14-8336-543cd4b2853f tempest-SnapshotDependencyTests-415004524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.info" returned: 0 in 0.304s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-59637e9f-4ca2-4b14-8336-543cd4b2853f tempest-SnapshotDependencyTests-415004524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.343s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-712938645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24e2904-0c18-4067-8cf9-66ae175048d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d67c97263152420896d01aae87b8f2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:01Z,use_quota=True,user_id='f8794abc0bbe4a7c9fe4a42e85624dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Creating volume b24e2904-0c18-4067-8cf9-66ae175048d1 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:15:01 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:15:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:01 devstack sudo[100508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1 1073741824
Nov 05 15:15:01 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-59637e9f-4ca2-4b14-8336-543cd4b2853f tempest-SnapshotDependencyTests-415004524 None] Create snapshot completed successfully
Nov 05 15:15:02 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1 1073741824" returned: 0 in 0.602s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:02 devstack sudo[100514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1
Nov 05 15:15:02 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:02 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1" returned: 0 in 0.433s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:15:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:15:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9b9b2b-ca6e-4949-87dd-b083398eb9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b24e2904-0c18-4067-8cf9-66ae175048d1', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:15:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7211efb-a3b0-468e-a430-f0e02bb76fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:15:02 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:15:02 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Volume volume-b24e2904-0c18-4067-8cf9-66ae175048d1 (b24e2904-0c18-4067-8cf9-66ae175048d1): created successfully
Nov 05 15:15:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7211efb-a3b0-468e-a430-f0e02bb76fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:15:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Flow 'volume_create_manager' (068c87d5-fcc7-462f-b155-53c5a23ddb12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:15:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Flow 'volume_create_manager' (3f18a4df-5c55-455e-ac59-8d654682c7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:15:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a14e1f3-de36-4873-a497-d349fde7343a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:15:02 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-4720f13f-fde4-451a-9b2a-b0c2dfe8914d req-4d64b0d9-a40d-43ae-a5ea-a6223c9e4b48 tempest-VolumesSnapshotsTestJSON-1104636245 None] Created volume successfully.
Nov 05 15:15:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-aae14a1a-b8bd-4a2b-8a94-01ab03ef92d5 req-b1344f91-850f-4f8f-97ad-62737b0f1c46 tempest-TestInstancesWithCinderVolumes-1687340720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:15:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-aae14a1a-b8bd-4a2b-8a94-01ab03ef92d5 req-b1344f91-850f-4f8f-97ad-62737b0f1c46 tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:15:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-aae14a1a-b8bd-4a2b-8a94-01ab03ef92d5 req-b1344f91-850f-4f8f-97ad-62737b0f1c46 tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:15:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a14e1f3-de36-4873-a497-d349fde7343a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505fe20f-ff53-419f-8308-6c515aa8da1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50b0ffb917ec42d9b0cd5217752f7b50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8caf94e0-5d40-4d1f-84dd-06d284ade0af,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:03Z,use_quota=True,user_id='be04f404385f4ff89f95a4d043a40d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:15:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8fe5d3d-76b3-41be-8192-96507ec0794d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:15:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8fe5d3d-76b3-41be-8192-96507ec0794d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:15:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2311a33-9433-4251-9cfc-8ee5865b969c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:15:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2311a33-9433-4251-9cfc-8ee5865b969c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '505fe20f-ff53-419f-8308-6c515aa8da1a', 'volume_name': 'volume-505fe20f-ff53-419f-8308-6c515aa8da1a', 'volume_size': 1, 'snapshot_id': '8caf94e0-5d40-4d1f-84dd-06d284ade0af'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:15:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9104e4e7-2dbd-40a9-81e8-d9d87b546ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9104e4e7-2dbd-40a9-81e8-d9d87b546ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15fececf-1ee3-4fc8-a24e-098e0c153519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:15:03 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Volume 505fe20f-ff53-419f-8308-6c515aa8da1a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-505fe20f-ff53-419f-8308-6c515aa8da1a', 'volume_size': 1, 'snapshot_id': '8caf94e0-5d40-4d1f-84dd-06d284ade0af'}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Acquiring lock "cinder-quobyte-8caf94e0-5d40-4d1f-84dd-06d284ade0af-505fe20f-ff53-419f-8308-6c515aa8da1a" by "_create_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-aae14a1a-b8bd-4a2b-8a94-01ab03ef92d5 req-b1344f91-850f-4f8f-97ad-62737b0f1c46 tempest-TestInstancesWithCinderVolumes-1687340720 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628', 'name': 'volume-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3e9da6b-cc42-4663-a9c6-564d0dbaf3d6', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Lock "cinder-quobyte-8caf94e0-5d40-4d1f-84dd-06d284ade0af-505fe20f-ff53-419f-8308-6c515aa8da1a" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Creating volume 505fe20f-ff53-419f-8308-6c515aa8da1a from snapshot 8caf94e0-5d40-4d1f-84dd-06d284ade0af {{(pid=87150) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Acquiring lock "cinder-quobyte-505fe20f-ff53-419f-8308-6c515aa8da1a" by "_copy_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Lock "cinder-quobyte-505fe20f-ff53-419f-8308-6c515aa8da1a" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] snapshot: 8caf94e0-5d40-4d1f-84dd-06d284ade0af, volume: 505fe20f-ff53-419f-8308-6c515aa8da1a,  {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[19593f0d-7021-4371-9241-c455203125d2]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.8caf94e0-5d40-4d1f-84dd-06d284ade0af {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-aae14a1a-b8bd-4a2b-8a94-01ab03ef92d5 req-b1344f91-850f-4f8f-97ad-62737b0f1c46 tempest-TestInstancesWithCinderVolumes-1687340720 None] attachment_update completed successfully.
Nov 05 15:15:03 devstack sudo[100525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.8caf94e0-5d40-4d1f-84dd-06d284ade0af
Nov 05 15:15:03 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-77db2a26-1f97-468c-b860-450c503edb62 req-4eddab77-896d-4b9b-bd41-dfd1b2cf8ba7 tempest-VolumesSnapshotsTestJSON-1104636245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:15:03 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.8caf94e0-5d40-4d1f-84dd-06d284ade0af" returned: 0 in 0.757s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:15:04 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff58ce51-ea62-4794-bb4d-bc1c304b567d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:15:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:04 devstack sudo[100530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1
Nov 05 15:15:04 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:04 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1" returned: 0 in 0.456s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1 {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 15:15:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Creating direct copy from snapshot {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 15:15:04 devstack cinder-volume[87150]: DEBUG cinder.utils [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Path /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-505fe20f-ff53-419f-8308-6c515aa8da1a not found in is_blk_device check {{(pid=87150) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 15:15:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-505fe20f-ff53-419f-8308-6c515aa8da1a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:04 devstack sudo[100536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-505fe20f-ff53-419f-8308-6c515aa8da1a
Nov 05 15:15:04 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:13 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=104,cinder:INSERT=32,cinder:UPDATE=100,cinder:DELETE=7 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:15:13 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=46,cinder:SELECT=44,cinder:INSERT=12,cinder:DELETE=6 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:15:15 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-505fe20f-ff53-419f-8308-6c515aa8da1a" returned: 0 in 11.169s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:15 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Image conversion details: src /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1, size 1024.00 MB, duration 11.17 sec, destination /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-505fe20f-ff53-419f-8308-6c515aa8da1a {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:15:15 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Converted 1024.00 MB image at 91.68 MB/s
Nov 05 15:15:15 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-505fe20f-ff53-419f-8308-6c515aa8da1a is being set with open permissions: ugo+rw
Nov 05 15:15:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-505fe20f-ff53-419f-8308-6c515aa8da1a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:15 devstack sudo[101033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-505fe20f-ff53-419f-8308-6c515aa8da1a
Nov 05 15:15:15 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:15 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-505fe20f-ff53-419f-8308-6c515aa8da1a" returned: 0 in 0.284s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Lock "cinder-quobyte-505fe20f-ff53-419f-8308-6c515aa8da1a" released by "_copy_volume_from_snapshot" :: held 12.813s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:15:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Lock "cinder-quobyte-8caf94e0-5d40-4d1f-84dd-06d284ade0af-505fe20f-ff53-419f-8308-6c515aa8da1a" released by "_create_volume_from_snapshot" :: held 12.960s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:15:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:15:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-77db2a26-1f97-468c-b860-450c503edb62 req-4eddab77-896d-4b9b-bd41-dfd1b2cf8ba7 tempest-VolumesSnapshotsTestJSON-1104636245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.105s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:15:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [req-77db2a26-1f97-468c-b860-450c503edb62 req-4eddab77-896d-4b9b-bd41-dfd1b2cf8ba7 tempest-VolumesSnapshotsTestJSON-1104636245 None] Creating offline snapshot 12601a4b-1f83-4a7f-8d29-693376a942ab of volume b24e2904-0c18-4067-8cf9-66ae175048d1 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:15:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15fececf-1ee3-4fc8-a24e-098e0c153519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-505fe20f-ff53-419f-8308-6c515aa8da1a', 'volume_size': 1, 'snapshot_id': '8caf94e0-5d40-4d1f-84dd-06d284ade0af'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:15:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0b6496-1e6d-431e-a4de-442f8e19e6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:15:16 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[522823e1-9f93-4859-8a00-2ec21b55f32c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:15:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-77db2a26-1f97-468c-b860-450c503edb62 req-4eddab77-896d-4b9b-bd41-dfd1b2cf8ba7 tempest-VolumesSnapshotsTestJSON-1104636245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:16 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Volume volume-505fe20f-ff53-419f-8308-6c515aa8da1a (505fe20f-ff53-419f-8308-6c515aa8da1a): created successfully
Nov 05 15:15:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0b6496-1e6d-431e-a4de-442f8e19e6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:15:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Flow 'volume_create_manager' (3f18a4df-5c55-455e-ac59-8d654682c7ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:15:16 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1108e39e-d242-4302-9a0c-93ee8c5f76f1 tempest-SnapshotDependencyTests-415004524 None] Created volume successfully.
Nov 05 15:15:16 devstack sudo[101036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1
Nov 05 15:15:16 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:16 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-77db2a26-1f97-468c-b860-450c503edb62 req-4eddab77-896d-4b9b-bd41-dfd1b2cf8ba7 tempest-VolumesSnapshotsTestJSON-1104636245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1" returned: 0 in 0.613s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-77db2a26-1f97-468c-b860-450c503edb62 req-4eddab77-896d-4b9b-bd41-dfd1b2cf8ba7 tempest-VolumesSnapshotsTestJSON-1104636245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.12601a4b-1f83-4a7f-8d29-693376a942ab 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:16 devstack sudo[101041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.12601a4b-1f83-4a7f-8d29-693376a942ab 1G
Nov 05 15:15:16 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dc3bb21a-1213-4da7-8e0e-f47d43ac2cb9 tempest-SnapshotDependencyTests-415004524 None] Acquiring lock "cinder-8caf94e0-5d40-4d1f-84dd-06d284ade0af-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:15:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dc3bb21a-1213-4da7-8e0e-f47d43ac2cb9 tempest-SnapshotDependencyTests-415004524 None] Lock "cinder-8caf94e0-5d40-4d1f-84dd-06d284ade0af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:15:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dc3bb21a-1213-4da7-8e0e-f47d43ac2cb9 tempest-SnapshotDependencyTests-415004524 None] Acquiring lock "cinder-quobyte-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:15:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dc3bb21a-1213-4da7-8e0e-f47d43ac2cb9 tempest-SnapshotDependencyTests-415004524 None] Lock "cinder-quobyte-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:15:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dc3bb21a-1213-4da7-8e0e-f47d43ac2cb9 tempest-SnapshotDependencyTests-415004524 None] Acquiring lock "cinder-quobyte-8caf94e0-5d40-4d1f-84dd-06d284ade0af" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:15:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dc3bb21a-1213-4da7-8e0e-f47d43ac2cb9 tempest-SnapshotDependencyTests-415004524 None] Lock "cinder-quobyte-8caf94e0-5d40-4d1f-84dd-06d284ade0af" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:15:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-dc3bb21a-1213-4da7-8e0e-f47d43ac2cb9 tempest-SnapshotDependencyTests-415004524 None] Deleting offline snapshot 8caf94e0-5d40-4d1f-84dd-06d284ade0af of volume 6451e404-e6cd-4d5b-89f8-5d2cd825a9c1 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:15:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-dc3bb21a-1213-4da7-8e0e-f47d43ac2cb9 tempest-SnapshotDependencyTests-415004524 None] snapshot_file for this snap is: volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.8caf94e0-5d40-4d1f-84dd-06d284ade0af {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:15:17 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-77db2a26-1f97-468c-b860-450c503edb62 req-4eddab77-896d-4b9b-bd41-dfd1b2cf8ba7 tempest-VolumesSnapshotsTestJSON-1104636245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.12601a4b-1f83-4a7f-8d29-693376a942ab 1G" returned: 0 in 0.907s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-77db2a26-1f97-468c-b860-450c503edb62 req-4eddab77-896d-4b9b-bd41-dfd1b2cf8ba7 tempest-VolumesSnapshotsTestJSON-1104636245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b24e2904-0c18-4067-8cf9-66ae175048d1 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.12601a4b-1f83-4a7f-8d29-693376a942ab {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:17 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e15a1c-bae3-4b9e-b858-ce5b9f7aaf64]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:15:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dc3bb21a-1213-4da7-8e0e-f47d43ac2cb9 tempest-SnapshotDependencyTests-415004524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.8caf94e0-5d40-4d1f-84dd-06d284ade0af {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:17 devstack sudo[101051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b24e2904-0c18-4067-8cf9-66ae175048d1 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.12601a4b-1f83-4a7f-8d29-693376a942ab
Nov 05 15:15:17 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:18 devstack sudo[101052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.8caf94e0-5d40-4d1f-84dd-06d284ade0af
Nov 05 15:15:18 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:18 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-77db2a26-1f97-468c-b860-450c503edb62 req-4eddab77-896d-4b9b-bd41-dfd1b2cf8ba7 tempest-VolumesSnapshotsTestJSON-1104636245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b24e2904-0c18-4067-8cf9-66ae175048d1 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.12601a4b-1f83-4a7f-8d29-693376a942ab" returned: 0 in 0.559s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:18 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [req-77db2a26-1f97-468c-b860-450c503edb62 req-4eddab77-896d-4b9b-bd41-dfd1b2cf8ba7 tempest-VolumesSnapshotsTestJSON-1104636245 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.12601a4b-1f83-4a7f-8d29-693376a942ab is being set with open permissions: ugo+rw
Nov 05 15:15:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-77db2a26-1f97-468c-b860-450c503edb62 req-4eddab77-896d-4b9b-bd41-dfd1b2cf8ba7 tempest-VolumesSnapshotsTestJSON-1104636245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.12601a4b-1f83-4a7f-8d29-693376a942ab {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:18 devstack sudo[101058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.12601a4b-1f83-4a7f-8d29-693376a942ab
Nov 05 15:15:18 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:18 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dc3bb21a-1213-4da7-8e0e-f47d43ac2cb9 tempest-SnapshotDependencyTests-415004524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.8caf94e0-5d40-4d1f-84dd-06d284ade0af" returned: 0 in 0.829s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-dc3bb21a-1213-4da7-8e0e-f47d43ac2cb9 tempest-SnapshotDependencyTests-415004524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:15:18 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[238d4519-c850-4edf-aa39-8dda569f7fc8]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:15:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dc3bb21a-1213-4da7-8e0e-f47d43ac2cb9 tempest-SnapshotDependencyTests-415004524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:18 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-77db2a26-1f97-468c-b860-450c503edb62 req-4eddab77-896d-4b9b-bd41-dfd1b2cf8ba7 tempest-VolumesSnapshotsTestJSON-1104636245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.12601a4b-1f83-4a7f-8d29-693376a942ab" returned: 0 in 0.517s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-77db2a26-1f97-468c-b860-450c503edb62 req-4eddab77-896d-4b9b-bd41-dfd1b2cf8ba7 tempest-VolumesSnapshotsTestJSON-1104636245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:18 devstack sudo[101065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.info
Nov 05 15:15:18 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:18 devstack sudo[101064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1
Nov 05 15:15:18 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:19 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-77db2a26-1f97-468c-b860-450c503edb62 req-4eddab77-896d-4b9b-bd41-dfd1b2cf8ba7 tempest-VolumesSnapshotsTestJSON-1104636245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.info" returned: 0 in 0.487s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:19 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [req-77db2a26-1f97-468c-b860-450c503edb62 req-4eddab77-896d-4b9b-bd41-dfd1b2cf8ba7 tempest-VolumesSnapshotsTestJSON-1104636245 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.info is being set with open permissions: ugo+rw
Nov 05 15:15:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-77db2a26-1f97-468c-b860-450c503edb62 req-4eddab77-896d-4b9b-bd41-dfd1b2cf8ba7 tempest-VolumesSnapshotsTestJSON-1104636245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:19 devstack sudo[101072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.info
Nov 05 15:15:19 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:19 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dc3bb21a-1213-4da7-8e0e-f47d43ac2cb9 tempest-SnapshotDependencyTests-415004524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1" returned: 0 in 1.001s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dc3bb21a-1213-4da7-8e0e-f47d43ac2cb9 tempest-SnapshotDependencyTests-415004524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.8caf94e0-5d40-4d1f-84dd-06d284ade0af {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:19 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-77db2a26-1f97-468c-b860-450c503edb62 req-4eddab77-896d-4b9b-bd41-dfd1b2cf8ba7 tempest-VolumesSnapshotsTestJSON-1104636245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.info" returned: 0 in 0.349s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:19 devstack sudo[101076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.8caf94e0-5d40-4d1f-84dd-06d284ade0af
Nov 05 15:15:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-77db2a26-1f97-468c-b860-450c503edb62 req-4eddab77-896d-4b9b-bd41-dfd1b2cf8ba7 tempest-VolumesSnapshotsTestJSON-1104636245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.616s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:15:19 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:19 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-77db2a26-1f97-468c-b860-450c503edb62 req-4eddab77-896d-4b9b-bd41-dfd1b2cf8ba7 tempest-VolumesSnapshotsTestJSON-1104636245 None] Create snapshot completed successfully
Nov 05 15:15:20 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dc3bb21a-1213-4da7-8e0e-f47d43ac2cb9 tempest-SnapshotDependencyTests-415004524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.8caf94e0-5d40-4d1f-84dd-06d284ade0af" returned: 0 in 0.546s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dc3bb21a-1213-4da7-8e0e-f47d43ac2cb9 tempest-SnapshotDependencyTests-415004524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.8caf94e0-5d40-4d1f-84dd-06d284ade0af {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:20 devstack sudo[101081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.8caf94e0-5d40-4d1f-84dd-06d284ade0af
Nov 05 15:15:20 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:20 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dc3bb21a-1213-4da7-8e0e-f47d43ac2cb9 tempest-SnapshotDependencyTests-415004524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1.8caf94e0-5d40-4d1f-84dd-06d284ade0af" returned: 0 in 0.373s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dc3bb21a-1213-4da7-8e0e-f47d43ac2cb9 tempest-SnapshotDependencyTests-415004524 None] Lock "cinder-quobyte-8caf94e0-5d40-4d1f-84dd-06d284ade0af" released by "_delete_snapshot" :: held 3.062s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:15:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dc3bb21a-1213-4da7-8e0e-f47d43ac2cb9 tempest-SnapshotDependencyTests-415004524 None] Lock "cinder-quobyte-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1" released by "delete_snapshot" :: held 3.120s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:15:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-64318963-8bd0-4cfc-b482-d1cf19af0606 req-f43116bb-486d-43fd-93cd-bbf40ea42ad4 tempest-VolumesSnapshotsTestJSON-1104636245 None] Acquiring lock "cinder-12601a4b-1f83-4a7f-8d29-693376a942ab-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:15:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-64318963-8bd0-4cfc-b482-d1cf19af0606 req-f43116bb-486d-43fd-93cd-bbf40ea42ad4 tempest-VolumesSnapshotsTestJSON-1104636245 None] Lock "cinder-12601a4b-1f83-4a7f-8d29-693376a942ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:15:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-64318963-8bd0-4cfc-b482-d1cf19af0606 req-f43116bb-486d-43fd-93cd-bbf40ea42ad4 tempest-VolumesSnapshotsTestJSON-1104636245 None] Acquiring lock "cinder-quobyte-b24e2904-0c18-4067-8cf9-66ae175048d1" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:15:20 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-dc3bb21a-1213-4da7-8e0e-f47d43ac2cb9 tempest-SnapshotDependencyTests-415004524 None] Created reservations ['84ef80b2-657b-42ee-bdb2-7366f3c5fe06', '388a500b-f5ad-4e46-8fb0-4615f18c2445', '544db28c-54d0-4277-bff0-314a523862a2', '5c553d99-e856-44e6-9576-cf8f806f2009'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:15:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-64318963-8bd0-4cfc-b482-d1cf19af0606 req-f43116bb-486d-43fd-93cd-bbf40ea42ad4 tempest-VolumesSnapshotsTestJSON-1104636245 None] Lock "cinder-quobyte-b24e2904-0c18-4067-8cf9-66ae175048d1" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:15:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-64318963-8bd0-4cfc-b482-d1cf19af0606 req-f43116bb-486d-43fd-93cd-bbf40ea42ad4 tempest-VolumesSnapshotsTestJSON-1104636245 None] Acquiring lock "cinder-quobyte-12601a4b-1f83-4a7f-8d29-693376a942ab" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:15:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-64318963-8bd0-4cfc-b482-d1cf19af0606 req-f43116bb-486d-43fd-93cd-bbf40ea42ad4 tempest-VolumesSnapshotsTestJSON-1104636245 None] Lock "cinder-quobyte-12601a4b-1f83-4a7f-8d29-693376a942ab" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:15:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [req-64318963-8bd0-4cfc-b482-d1cf19af0606 req-f43116bb-486d-43fd-93cd-bbf40ea42ad4 tempest-VolumesSnapshotsTestJSON-1104636245 None] Deleting offline snapshot 12601a4b-1f83-4a7f-8d29-693376a942ab of volume b24e2904-0c18-4067-8cf9-66ae175048d1 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:15:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [req-64318963-8bd0-4cfc-b482-d1cf19af0606 req-f43116bb-486d-43fd-93cd-bbf40ea42ad4 tempest-VolumesSnapshotsTestJSON-1104636245 None] snapshot_file for this snap is: volume-b24e2904-0c18-4067-8cf9-66ae175048d1.12601a4b-1f83-4a7f-8d29-693376a942ab {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:15:20 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[39df5dea-a7d1-430a-8f25-29c77a8e8a8a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:15:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-64318963-8bd0-4cfc-b482-d1cf19af0606 req-f43116bb-486d-43fd-93cd-bbf40ea42ad4 tempest-VolumesSnapshotsTestJSON-1104636245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.12601a4b-1f83-4a7f-8d29-693376a942ab {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:21 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-dc3bb21a-1213-4da7-8e0e-f47d43ac2cb9 tempest-SnapshotDependencyTests-415004524 None] Delete snapshot completed successfully.
Nov 05 15:15:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dc3bb21a-1213-4da7-8e0e-f47d43ac2cb9 tempest-SnapshotDependencyTests-415004524 None] Lock "cinder-8caf94e0-5d40-4d1f-84dd-06d284ade0af-delete_snapshot" released by "delete_snapshot" :: held 3.563s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:15:21 devstack sudo[101124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.12601a4b-1f83-4a7f-8d29-693376a942ab
Nov 05 15:15:21 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:21 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-64318963-8bd0-4cfc-b482-d1cf19af0606 req-f43116bb-486d-43fd-93cd-bbf40ea42ad4 tempest-VolumesSnapshotsTestJSON-1104636245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.12601a4b-1f83-4a7f-8d29-693376a942ab" returned: 0 in 0.581s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [req-64318963-8bd0-4cfc-b482-d1cf19af0606 req-f43116bb-486d-43fd-93cd-bbf40ea42ad4 tempest-VolumesSnapshotsTestJSON-1104636245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b24e2904-0c18-4067-8cf9-66ae175048d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:15:21 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b54782d-41df-4bb4-9bdd-f91535e9ad3c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:15:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-64318963-8bd0-4cfc-b482-d1cf19af0606 req-f43116bb-486d-43fd-93cd-bbf40ea42ad4 tempest-VolumesSnapshotsTestJSON-1104636245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:21 devstack sudo[101131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1
Nov 05 15:15:21 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a177afb0-d5bc-4d59-9976-5537a285d205 tempest-SnapshotDependencyTests-415004524 None] Acquiring lock "cinder-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:15:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a177afb0-d5bc-4d59-9976-5537a285d205 tempest-SnapshotDependencyTests-415004524 None] Lock "cinder-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:15:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a177afb0-d5bc-4d59-9976-5537a285d205 tempest-SnapshotDependencyTests-415004524 None] Acquiring lock "cinder-quobyte-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:15:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a177afb0-d5bc-4d59-9976-5537a285d205 tempest-SnapshotDependencyTests-415004524 None] Lock "cinder-quobyte-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1" acquired by "delete_volume" :: waited 0.048s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:15:22 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[29250838-704c-4997-8f3c-c8b4d6a4340f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:15:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a177afb0-d5bc-4d59-9976-5537a285d205 tempest-SnapshotDependencyTests-415004524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:22 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-64318963-8bd0-4cfc-b482-d1cf19af0606 req-f43116bb-486d-43fd-93cd-bbf40ea42ad4 tempest-VolumesSnapshotsTestJSON-1104636245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1" returned: 0 in 0.818s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-64318963-8bd0-4cfc-b482-d1cf19af0606 req-f43116bb-486d-43fd-93cd-bbf40ea42ad4 tempest-VolumesSnapshotsTestJSON-1104636245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.12601a4b-1f83-4a7f-8d29-693376a942ab {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:22 devstack sudo[101134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1
Nov 05 15:15:22 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:22 devstack sudo[101138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.12601a4b-1f83-4a7f-8d29-693376a942ab
Nov 05 15:15:22 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:22 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a177afb0-d5bc-4d59-9976-5537a285d205 tempest-SnapshotDependencyTests-415004524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1" returned: 0 in 0.651s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a177afb0-d5bc-4d59-9976-5537a285d205 tempest-SnapshotDependencyTests-415004524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:22 devstack sudo[101145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1
Nov 05 15:15:22 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:23 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-64318963-8bd0-4cfc-b482-d1cf19af0606 req-f43116bb-486d-43fd-93cd-bbf40ea42ad4 tempest-VolumesSnapshotsTestJSON-1104636245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.12601a4b-1f83-4a7f-8d29-693376a942ab" returned: 0 in 0.727s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-64318963-8bd0-4cfc-b482-d1cf19af0606 req-f43116bb-486d-43fd-93cd-bbf40ea42ad4 tempest-VolumesSnapshotsTestJSON-1104636245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.12601a4b-1f83-4a7f-8d29-693376a942ab {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:23 devstack sudo[101149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.12601a4b-1f83-4a7f-8d29-693376a942ab
Nov 05 15:15:23 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:23 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a177afb0-d5bc-4d59-9976-5537a285d205 tempest-SnapshotDependencyTests-415004524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1" returned: 0 in 0.475s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a177afb0-d5bc-4d59-9976-5537a285d205 tempest-SnapshotDependencyTests-415004524 None] Lock "cinder-quobyte-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1" released by "delete_volume" :: held 1.234s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:15:23 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-a177afb0-d5bc-4d59-9976-5537a285d205 tempest-SnapshotDependencyTests-415004524 None] Created reservations ['94c99b1c-e2d6-412d-b1e5-c6c611659b4c', 'd5317a01-7ecc-4e8b-8dde-77068d4adaac', '96aa138a-9794-4e38-b031-e976277322ce', 'd430417c-869c-4a8e-a5ac-9a1eb58a7e3a'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:15:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a177afb0-d5bc-4d59-9976-5537a285d205 tempest-SnapshotDependencyTests-415004524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:15:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a177afb0-d5bc-4d59-9976-5537a285d205 tempest-SnapshotDependencyTests-415004524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:15:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a177afb0-d5bc-4d59-9976-5537a285d205 tempest-SnapshotDependencyTests-415004524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:15:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a177afb0-d5bc-4d59-9976-5537a285d205 tempest-SnapshotDependencyTests-415004524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:15:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a177afb0-d5bc-4d59-9976-5537a285d205 tempest-SnapshotDependencyTests-415004524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:15:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a177afb0-d5bc-4d59-9976-5537a285d205 tempest-SnapshotDependencyTests-415004524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:23 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-64318963-8bd0-4cfc-b482-d1cf19af0606 req-f43116bb-486d-43fd-93cd-bbf40ea42ad4 tempest-VolumesSnapshotsTestJSON-1104636245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1.12601a4b-1f83-4a7f-8d29-693376a942ab" returned: 0 in 0.605s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:23 devstack sudo[101154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:15:23 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-64318963-8bd0-4cfc-b482-d1cf19af0606 req-f43116bb-486d-43fd-93cd-bbf40ea42ad4 tempest-VolumesSnapshotsTestJSON-1104636245 None] Lock "cinder-quobyte-12601a4b-1f83-4a7f-8d29-693376a942ab" released by "_delete_snapshot" :: held 2.925s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:15:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-64318963-8bd0-4cfc-b482-d1cf19af0606 req-f43116bb-486d-43fd-93cd-bbf40ea42ad4 tempest-VolumesSnapshotsTestJSON-1104636245 None] Lock "cinder-quobyte-b24e2904-0c18-4067-8cf9-66ae175048d1" released by "delete_snapshot" :: held 2.978s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:15:23 devstack cinder-volume[87150]: DEBUG cinder.quota [req-64318963-8bd0-4cfc-b482-d1cf19af0606 req-f43116bb-486d-43fd-93cd-bbf40ea42ad4 tempest-VolumesSnapshotsTestJSON-1104636245 None] Created reservations ['d16c42fd-6381-410e-bc58-ce9649bd3d28', '58218e3e-0200-48e8-ae27-fa03053747c3', '9cad3026-931c-4aec-aca4-15515fa0c213', '6f13a893-6abf-4fb5-8696-0e0a31a91086'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:15:24 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-64318963-8bd0-4cfc-b482-d1cf19af0606 req-f43116bb-486d-43fd-93cd-bbf40ea42ad4 tempest-VolumesSnapshotsTestJSON-1104636245 None] Delete snapshot completed successfully.
Nov 05 15:15:24 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-64318963-8bd0-4cfc-b482-d1cf19af0606 req-f43116bb-486d-43fd-93cd-bbf40ea42ad4 tempest-VolumesSnapshotsTestJSON-1104636245 None] Lock "cinder-12601a4b-1f83-4a7f-8d29-693376a942ab-delete_snapshot" released by "delete_snapshot" :: held 3.296s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:15:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a177afb0-d5bc-4d59-9976-5537a285d205 tempest-SnapshotDependencyTests-415004524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.389s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:24 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a177afb0-d5bc-4d59-9976-5537a285d205 tempest-SnapshotDependencyTests-415004524 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:15:24 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a177afb0-d5bc-4d59-9976-5537a285d205 tempest-SnapshotDependencyTests-415004524 None] Deleted volume successfully.
Nov 05 15:15:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a177afb0-d5bc-4d59-9976-5537a285d205 tempest-SnapshotDependencyTests-415004524 None] Lock "cinder-6451e404-e6cd-4d5b-89f8-5d2cd825a9c1-delete_volume" released by "delete_volume" :: held 2.180s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:15:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2b534188-4a5d-457d-ac4d-be75e4442ffb tempest-SnapshotDependencyTests-415004524 None] Acquiring lock "cinder-505fe20f-ff53-419f-8308-6c515aa8da1a-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:15:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2b534188-4a5d-457d-ac4d-be75e4442ffb tempest-SnapshotDependencyTests-415004524 None] Lock "cinder-505fe20f-ff53-419f-8308-6c515aa8da1a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:15:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2b534188-4a5d-457d-ac4d-be75e4442ffb tempest-SnapshotDependencyTests-415004524 None] Acquiring lock "cinder-quobyte-505fe20f-ff53-419f-8308-6c515aa8da1a" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:15:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2b534188-4a5d-457d-ac4d-be75e4442ffb tempest-SnapshotDependencyTests-415004524 None] Lock "cinder-quobyte-505fe20f-ff53-419f-8308-6c515aa8da1a" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:15:24 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cd5210-a06c-4911-ba88-084fcda1d8af]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:15:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2b534188-4a5d-457d-ac4d-be75e4442ffb tempest-SnapshotDependencyTests-415004524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-505fe20f-ff53-419f-8308-6c515aa8da1a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:24 devstack sudo[101157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-505fe20f-ff53-419f-8308-6c515aa8da1a
Nov 05 15:15:24 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-d57cf684-fea8-40a6-b813-55c2c35e4a5e req-652fc674-fdc8-4fff-b282-9dba7a564eb3 tempest-VolumesSnapshotsTestJSON-1104636245 None] Acquiring lock "cinder-b24e2904-0c18-4067-8cf9-66ae175048d1-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:15:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-d57cf684-fea8-40a6-b813-55c2c35e4a5e req-652fc674-fdc8-4fff-b282-9dba7a564eb3 tempest-VolumesSnapshotsTestJSON-1104636245 None] Lock "cinder-b24e2904-0c18-4067-8cf9-66ae175048d1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:15:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-d57cf684-fea8-40a6-b813-55c2c35e4a5e req-652fc674-fdc8-4fff-b282-9dba7a564eb3 tempest-VolumesSnapshotsTestJSON-1104636245 None] Acquiring lock "cinder-quobyte-b24e2904-0c18-4067-8cf9-66ae175048d1" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:15:25 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2b534188-4a5d-457d-ac4d-be75e4442ffb tempest-SnapshotDependencyTests-415004524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-505fe20f-ff53-419f-8308-6c515aa8da1a" returned: 0 in 0.729s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2b534188-4a5d-457d-ac4d-be75e4442ffb tempest-SnapshotDependencyTests-415004524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-505fe20f-ff53-419f-8308-6c515aa8da1a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-d57cf684-fea8-40a6-b813-55c2c35e4a5e req-652fc674-fdc8-4fff-b282-9dba7a564eb3 tempest-VolumesSnapshotsTestJSON-1104636245 None] Lock "cinder-quobyte-b24e2904-0c18-4067-8cf9-66ae175048d1" acquired by "delete_volume" :: waited 0.055s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:15:25 devstack sudo[101165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-505fe20f-ff53-419f-8308-6c515aa8da1a
Nov 05 15:15:25 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:25 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b493a8-29ea-4549-ac76-65472af3222b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:15:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-d57cf684-fea8-40a6-b813-55c2c35e4a5e req-652fc674-fdc8-4fff-b282-9dba7a564eb3 tempest-VolumesSnapshotsTestJSON-1104636245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:25 devstack sudo[101167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1
Nov 05 15:15:25 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:25 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2b534188-4a5d-457d-ac4d-be75e4442ffb tempest-SnapshotDependencyTests-415004524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-505fe20f-ff53-419f-8308-6c515aa8da1a" returned: 0 in 0.386s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2b534188-4a5d-457d-ac4d-be75e4442ffb tempest-SnapshotDependencyTests-415004524 None] Lock "cinder-quobyte-505fe20f-ff53-419f-8308-6c515aa8da1a" released by "delete_volume" :: held 1.187s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:15:25 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-2b534188-4a5d-457d-ac4d-be75e4442ffb tempest-SnapshotDependencyTests-415004524 None] Created reservations ['47cc43c4-9df2-4007-8601-5046bf4c38d3', '9c60218a-6f2f-4211-83a2-db43c0e5add2', '431ebb03-5c63-4964-be35-0b4800b82fe9', '5e853673-0aae-4093-9aab-e2ebcfd67810'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:15:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2b534188-4a5d-457d-ac4d-be75e4442ffb tempest-SnapshotDependencyTests-415004524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:15:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2b534188-4a5d-457d-ac4d-be75e4442ffb tempest-SnapshotDependencyTests-415004524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:15:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2b534188-4a5d-457d-ac4d-be75e4442ffb tempest-SnapshotDependencyTests-415004524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:15:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2b534188-4a5d-457d-ac4d-be75e4442ffb tempest-SnapshotDependencyTests-415004524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:15:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2b534188-4a5d-457d-ac4d-be75e4442ffb tempest-SnapshotDependencyTests-415004524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:15:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2b534188-4a5d-457d-ac4d-be75e4442ffb tempest-SnapshotDependencyTests-415004524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:25 devstack sudo[101172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:15:25 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:25 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-d57cf684-fea8-40a6-b813-55c2c35e4a5e req-652fc674-fdc8-4fff-b282-9dba7a564eb3 tempest-VolumesSnapshotsTestJSON-1104636245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1" returned: 0 in 0.608s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-d57cf684-fea8-40a6-b813-55c2c35e4a5e req-652fc674-fdc8-4fff-b282-9dba7a564eb3 tempest-VolumesSnapshotsTestJSON-1104636245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:25 devstack sudo[101175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1
Nov 05 15:15:25 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:26 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2b534188-4a5d-457d-ac4d-be75e4442ffb tempest-SnapshotDependencyTests-415004524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.352s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:26 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-2b534188-4a5d-457d-ac4d-be75e4442ffb tempest-SnapshotDependencyTests-415004524 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:15:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2b534188-4a5d-457d-ac4d-be75e4442ffb tempest-SnapshotDependencyTests-415004524 None] Deleted volume successfully.
Nov 05 15:15:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2b534188-4a5d-457d-ac4d-be75e4442ffb tempest-SnapshotDependencyTests-415004524 None] Lock "cinder-505fe20f-ff53-419f-8308-6c515aa8da1a-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:15:26 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-d57cf684-fea8-40a6-b813-55c2c35e4a5e req-652fc674-fdc8-4fff-b282-9dba7a564eb3 tempest-VolumesSnapshotsTestJSON-1104636245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b24e2904-0c18-4067-8cf9-66ae175048d1" returned: 0 in 0.365s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-d57cf684-fea8-40a6-b813-55c2c35e4a5e req-652fc674-fdc8-4fff-b282-9dba7a564eb3 tempest-VolumesSnapshotsTestJSON-1104636245 None] Lock "cinder-quobyte-b24e2904-0c18-4067-8cf9-66ae175048d1" released by "delete_volume" :: held 1.059s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:15:26 devstack cinder-volume[87150]: DEBUG cinder.quota [req-d57cf684-fea8-40a6-b813-55c2c35e4a5e req-652fc674-fdc8-4fff-b282-9dba7a564eb3 tempest-VolumesSnapshotsTestJSON-1104636245 None] Created reservations ['2ab131fd-80d2-443b-b4b0-2a9c5df9965f', '3f0ca6f4-c760-41a6-aa52-a3a2829e52a0', '976f0f24-034d-4dae-94e3-0e31c2ca7489', '73013cb6-9b86-474e-ad00-897c976b91b8'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:15:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-d57cf684-fea8-40a6-b813-55c2c35e4a5e req-652fc674-fdc8-4fff-b282-9dba7a564eb3 tempest-VolumesSnapshotsTestJSON-1104636245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:15:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-d57cf684-fea8-40a6-b813-55c2c35e4a5e req-652fc674-fdc8-4fff-b282-9dba7a564eb3 tempest-VolumesSnapshotsTestJSON-1104636245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:15:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-d57cf684-fea8-40a6-b813-55c2c35e4a5e req-652fc674-fdc8-4fff-b282-9dba7a564eb3 tempest-VolumesSnapshotsTestJSON-1104636245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:15:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-d57cf684-fea8-40a6-b813-55c2c35e4a5e req-652fc674-fdc8-4fff-b282-9dba7a564eb3 tempest-VolumesSnapshotsTestJSON-1104636245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:15:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-d57cf684-fea8-40a6-b813-55c2c35e4a5e req-652fc674-fdc8-4fff-b282-9dba7a564eb3 tempest-VolumesSnapshotsTestJSON-1104636245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:15:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-d57cf684-fea8-40a6-b813-55c2c35e4a5e req-652fc674-fdc8-4fff-b282-9dba7a564eb3 tempest-VolumesSnapshotsTestJSON-1104636245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:26 devstack sudo[101203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:15:26 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:26 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-d57cf684-fea8-40a6-b813-55c2c35e4a5e req-652fc674-fdc8-4fff-b282-9dba7a564eb3 tempest-VolumesSnapshotsTestJSON-1104636245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.380s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:26 devstack cinder-volume[87150]: DEBUG cinder.manager [req-d57cf684-fea8-40a6-b813-55c2c35e4a5e req-652fc674-fdc8-4fff-b282-9dba7a564eb3 tempest-VolumesSnapshotsTestJSON-1104636245 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:15:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-d57cf684-fea8-40a6-b813-55c2c35e4a5e req-652fc674-fdc8-4fff-b282-9dba7a564eb3 tempest-VolumesSnapshotsTestJSON-1104636245 None] Deleted volume successfully.
Nov 05 15:15:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-d57cf684-fea8-40a6-b813-55c2c35e4a5e req-652fc674-fdc8-4fff-b282-9dba7a564eb3 tempest-VolumesSnapshotsTestJSON-1104636245 None] Lock "cinder-b24e2904-0c18-4067-8cf9-66ae175048d1-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:15:36 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=29,cinder:UPDATE=42,cinder:DELETE=3,cinder:INSERT=11 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:15:36 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=35,cinder:SELECT=32,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:15:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:15:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 15:15:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread info: [<_MainThread(MainThread, started 136317437956224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136317326340928)>, <Thread(Thread-3 (stat_writer), started daemon 136317326487936)>, <Thread(Rabbit-heartbeat, started daemon 136317321464000)>, <Thread(Thread-5 (_runner), started daemon 136317321550592)>, <Thread(Thread-7 (_runner), started daemon 136317321658496)>, <Thread(fd_logger, started daemon 136317319612992)>, <Thread(privsep_reader, started daemon 136317319622400)>, <Thread(tpool_thread_0, started daemon 136317310928576)>, <Thread(tpool_thread_1, started daemon 136317302535872)>, <Thread(tpool_thread_2, started daemon 136317294143168)>, <Thread(tpool_thread_3, started daemon 136317285750464)>, <Thread(tpool_thread_4, started daemon 136317277357760)>, <Thread(tpool_thread_5, started daemon 136317268965056)>, <Thread(tpool_thread_6, started daemon 136317260572352)>, <Thread(tpool_thread_7, started daemon 136317252179648)>, <Thread(tpool_thread_8, started daemon 136317243786944)>, <Thread(tpool_thread_9, started daemon 136317235394240)>, <Thread(tpool_thread_10, started daemon 136317227001536)>, <Thread(tpool_thread_11, started daemon 136317218608832)>, <Thread(tpool_thread_12, started daemon 136317210216128)>, <Thread(tpool_thread_13, started daemon 136317201807040)>, <Thread(tpool_thread_14, started daemon 136317193397952)>, <Thread(tpool_thread_15, started daemon 136317184988864)>, <Thread(tpool_thread_16, started daemon 136317176579776)>, <Thread(tpool_thread_17, started daemon 136317168170688)>, <Thread(tpool_thread_18, started daemon 136317159761600)>, <Thread(tpool_thread_19, started daemon 136317151352512)>] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 15:15:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e51669b3-7a7e-47b8-a6bf-377b72cd1967 tempest-BackendsCapabilitiesAdminTestsJSON-1212626188 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4655227661133, 'free_capacity_gb': 1773.4655227661133, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87150) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 05 15:15:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42fd8217-a22d-4de5-b918-2a1a187b2412 tempest-BackendsCapabilitiesAdminTestsJSON-1212626188 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4655227661133, 'free_capacity_gb': 1773.4655227661133, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87150) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 05 15:15:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-35f5bd63-0fad-42dc-9186-d01e92764789 req-b8fe47ce-6373-4b0f-b3fe-9b420f2099cc tempest-TestInstancesWithCinderVolumes-1687340720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:15:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-35f5bd63-0fad-42dc-9186-d01e92764789 req-b8fe47ce-6373-4b0f-b3fe-9b420f2099cc tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:15:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-35f5bd63-0fad-42dc-9186-d01e92764789 req-b8fe47ce-6373-4b0f-b3fe-9b420f2099cc tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:15:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-35f5bd63-0fad-42dc-9186-d01e92764789 req-b8fe47ce-6373-4b0f-b3fe-9b420f2099cc tempest-TestInstancesWithCinderVolumes-1687340720 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628', 'name': 'volume-fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7afc7eb2-d393-41ec-a268-e23c6dc773bc', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 15:15:43 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-35f5bd63-0fad-42dc-9186-d01e92764789 req-b8fe47ce-6373-4b0f-b3fe-9b420f2099cc tempest-TestInstancesWithCinderVolumes-1687340720 None] attachment_update completed successfully.
Nov 05 15:15:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-db342838-585e-46d7-b6ea-6c7e1e9bb495 req-1780355b-b7bc-49a1-af15-ca8cf181993b tempest-TestInstancesWithCinderVolumes-1687340720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:15:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-db342838-585e-46d7-b6ea-6c7e1e9bb495 req-1780355b-b7bc-49a1-af15-ca8cf181993b tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:15:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-db342838-585e-46d7-b6ea-6c7e1e9bb495 req-1780355b-b7bc-49a1-af15-ca8cf181993b tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:15:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-db342838-585e-46d7-b6ea-6c7e1e9bb495 req-1780355b-b7bc-49a1-af15-ca8cf181993b tempest-TestInstancesWithCinderVolumes-1687340720 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628', 'name': 'volume-8a0ae42f-7eca-4150-a9bc-c4be12414c53', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a9f8acb-622d-4a44-b15a-f9a07794807b', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 15:15:45 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-db342838-585e-46d7-b6ea-6c7e1e9bb495 req-1780355b-b7bc-49a1-af15-ca8cf181993b tempest-TestInstancesWithCinderVolumes-1687340720 None] attachment_update completed successfully.
Nov 05 15:15:50 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-4aeca652-e9bf-46fd-ba58-da1e776f000f req-8dce12e3-a834-4d61-ad60-c8d6f3c861b4 tempest-TestInstancesWithCinderVolumes-1687340720 None] Terminate volume connection completed successfully.
Nov 05 15:15:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-4aeca652-e9bf-46fd-ba58-da1e776f000f req-8dce12e3-a834-4d61-ad60-c8d6f3c861b4 tempest-TestInstancesWithCinderVolumes-1687340720 None] Deleting attachment 7afc7eb2-d393-41ec-a268-e23c6dc773bc. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 15:15:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-04799f77-4439-4bcb-a7e8-b29e8dead805 tempest-TestInstancesWithCinderVolumes-1687340720 None] Acquiring lock "cinder-fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:15:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-04799f77-4439-4bcb-a7e8-b29e8dead805 tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "cinder-fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:15:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-04799f77-4439-4bcb-a7e8-b29e8dead805 tempest-TestInstancesWithCinderVolumes-1687340720 None] Acquiring lock "cinder-quobyte-fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:15:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-04799f77-4439-4bcb-a7e8-b29e8dead805 tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "cinder-quobyte-fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:15:51 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd3dbe6-9a78-40ef-b222-537cb1ec2116]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:15:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-04799f77-4439-4bcb-a7e8-b29e8dead805 tempest-TestInstancesWithCinderVolumes-1687340720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:51 devstack sudo[101410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01
Nov 05 15:15:51 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:52 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-04799f77-4439-4bcb-a7e8-b29e8dead805 tempest-TestInstancesWithCinderVolumes-1687340720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01" returned: 0 in 0.477s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-04799f77-4439-4bcb-a7e8-b29e8dead805 tempest-TestInstancesWithCinderVolumes-1687340720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:52 devstack sudo[101416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01
Nov 05 15:15:52 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:52 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-04799f77-4439-4bcb-a7e8-b29e8dead805 tempest-TestInstancesWithCinderVolumes-1687340720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01" returned: 0 in 0.285s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-04799f77-4439-4bcb-a7e8-b29e8dead805 tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "cinder-quobyte-fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01" released by "delete_volume" :: held 0.824s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:15:52 devstack cinder-volume[87150]: WARNING cinder.quota [None req-04799f77-4439-4bcb-a7e8-b29e8dead805 tempest-TestInstancesWithCinderVolumes-1687340720 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-853967522-1233225813 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-853967522-1233225813, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:15:52 devstack cinder-volume[87150]: WARNING cinder.quota [None req-04799f77-4439-4bcb-a7e8-b29e8dead805 tempest-TestInstancesWithCinderVolumes-1687340720 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-853967522-1233225813 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-853967522-1233225813, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:15:52 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-04799f77-4439-4bcb-a7e8-b29e8dead805 tempest-TestInstancesWithCinderVolumes-1687340720 None] Created reservations ['ce7aa904-610d-4088-9b42-897ad8928181', 'f1d0dadd-8347-42a2-942a-f5b5199c9d88', '0317e2cd-4670-49b8-b63c-f84d25158257', '6dffd641-5191-4586-8852-286aaf4447d6'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:15:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-04799f77-4439-4bcb-a7e8-b29e8dead805 tempest-TestInstancesWithCinderVolumes-1687340720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:15:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-04799f77-4439-4bcb-a7e8-b29e8dead805 tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:15:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-04799f77-4439-4bcb-a7e8-b29e8dead805 tempest-TestInstancesWithCinderVolumes-1687340720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:15:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-04799f77-4439-4bcb-a7e8-b29e8dead805 tempest-TestInstancesWithCinderVolumes-1687340720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:15:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-04799f77-4439-4bcb-a7e8-b29e8dead805 tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:15:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-04799f77-4439-4bcb-a7e8-b29e8dead805 tempest-TestInstancesWithCinderVolumes-1687340720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:52 devstack sudo[101419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:15:52 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:52 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-04799f77-4439-4bcb-a7e8-b29e8dead805 tempest-TestInstancesWithCinderVolumes-1687340720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.323s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:52 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-04799f77-4439-4bcb-a7e8-b29e8dead805 tempest-TestInstancesWithCinderVolumes-1687340720 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:15:52 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-04799f77-4439-4bcb-a7e8-b29e8dead805 tempest-TestInstancesWithCinderVolumes-1687340720 None] Deleted volume successfully.
Nov 05 15:15:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-04799f77-4439-4bcb-a7e8-b29e8dead805 tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "cinder-fbcfb7db-6abb-41f6-bcdc-ffed74b0dc01-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:15:53 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:15:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Flow 'volume_create_manager' (6bfa0cf9-eb7a-418b-8646-5f9d686a462d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:15:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9aed03-c888-4b89-a6a7-d242ecdebc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:15:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9aed03-c888-4b89-a6a7-d242ecdebc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1134642712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa6b6e28-073d-4e76-8acb-82534904a72e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d816da7aaea34ae4af9b51dfd4f9c4da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:53Z,use_quota=True,user_id='02e6440682ac432baa27cdc246154c24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:15:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4590a36e-473b-49fa-adef-52401d509698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:15:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4590a36e-473b-49fa-adef-52401d509698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:15:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d632237-0745-41ce-a48a-5701ba0bf562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:15:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d632237-0745-41ce-a48a-5701ba0bf562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa6b6e28-073d-4e76-8acb-82534904a72e', 'volume_name': 'volume-fa6b6e28-073d-4e76-8acb-82534904a72e', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:15:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f47e59-d8a1-4a60-b312-6c2a5584c9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:15:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f47e59-d8a1-4a60-b312-6c2a5584c9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:15:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab920fd-0a6e-4216-9a85-e6813d897822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:15:53 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Volume fa6b6e28-073d-4e76-8acb-82534904a72e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa6b6e28-073d-4e76-8acb-82534904a72e', 'volume_size': 1}
Nov 05 15:15:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:15:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:15:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1134642712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa6b6e28-073d-4e76-8acb-82534904a72e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d816da7aaea34ae4af9b51dfd4f9c4da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:53Z,use_quota=True,user_id='02e6440682ac432baa27cdc246154c24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:15:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Creating volume fa6b6e28-073d-4e76-8acb-82534904a72e {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:15:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:15:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:15:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:15:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:15:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:15:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:15:53 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:15:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:53 devstack sudo[101422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e 1073741824
Nov 05 15:15:53 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:54 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e 1073741824" returned: 0 in 0.548s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:54 devstack sudo[101432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e
Nov 05 15:15:54 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:54 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e" returned: 0 in 0.316s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:15:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:15:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab920fd-0a6e-4216-9a85-e6813d897822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa6b6e28-073d-4e76-8acb-82534904a72e', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:15:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbfff964-edd9-4bef-ad3d-9aff6655a62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:15:54 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Volume volume-fa6b6e28-073d-4e76-8acb-82534904a72e (fa6b6e28-073d-4e76-8acb-82534904a72e): created successfully
Nov 05 15:15:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbfff964-edd9-4bef-ad3d-9aff6655a62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:15:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Flow 'volume_create_manager' (6bfa0cf9-eb7a-418b-8646-5f9d686a462d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:15:54 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-950fca10-246a-42d5-bc9b-0dc680d49b59 tempest-SnapshotsActionsTest-1456956290 None] Created volume successfully.
Nov 05 15:15:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-13975b62-f6ec-4cf0-ba69-90f0ba9e6ea2 tempest-SnapshotsActionsTest-1456956290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:15:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-13975b62-f6ec-4cf0-ba69-90f0ba9e6ea2 tempest-SnapshotsActionsTest-1456956290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:15:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-13975b62-f6ec-4cf0-ba69-90f0ba9e6ea2 tempest-SnapshotsActionsTest-1456956290 None] Creating offline snapshot 4684906e-99d9-45ec-b0e7-d381a735506b of volume fa6b6e28-073d-4e76-8acb-82534904a72e {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:15:55 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0586ba22-63ad-4304-a142-4e2a90a4d2c5]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:15:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-13975b62-f6ec-4cf0-ba69-90f0ba9e6ea2 tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:55 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-39fecebf-560c-4a86-9f1c-e29e2f280fb3 req-3d75a24f-5a14-430f-8fd7-58621356698b tempest-TestInstancesWithCinderVolumes-1687340720 None] Terminate volume connection completed successfully.
Nov 05 15:15:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-39fecebf-560c-4a86-9f1c-e29e2f280fb3 req-3d75a24f-5a14-430f-8fd7-58621356698b tempest-TestInstancesWithCinderVolumes-1687340720 None] Deleting attachment 4a9f8acb-622d-4a44-b15a-f9a07794807b. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 15:15:56 devstack sudo[101455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e
Nov 05 15:15:56 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:56 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-13975b62-f6ec-4cf0-ba69-90f0ba9e6ea2 tempest-SnapshotsActionsTest-1456956290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e" returned: 0 in 0.423s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-13975b62-f6ec-4cf0-ba69-90f0ba9e6ea2 tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:56 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:15:56 devstack sudo[101460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b 1G
Nov 05 15:15:56 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Flow 'volume_create_manager' (7ddac09f-69f2-4623-98fc-4263db3791cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:15:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1eb4e9-ce5b-452d-8ebc-cf9cfb5ea309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:15:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1eb4e9-ce5b-452d-8ebc-cf9cfb5ea309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-961006592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654dd6ea-08a9-4a53-9054-82ac41975404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebd5bd8e01ba4c0fb7fc29b74c991796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:56Z,use_quota=True,user_id='73262e81d97b4c40842ec92f7e44d3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:15:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53fc9bb4-280c-4516-8ffe-31b9602cf3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:15:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53fc9bb4-280c-4516-8ffe-31b9602cf3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:15:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d17abc1c-e42f-4524-8c34-2547036b2b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:15:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d17abc1c-e42f-4524-8c34-2547036b2b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '654dd6ea-08a9-4a53-9054-82ac41975404', 'volume_name': 'volume-654dd6ea-08a9-4a53-9054-82ac41975404', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:15:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce86df2-3ddf-4113-8dd1-a5cf043e82fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:15:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce86df2-3ddf-4113-8dd1-a5cf043e82fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:15:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4083954a-2989-4fef-9a68-afbda89a13f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:15:56 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Volume 654dd6ea-08a9-4a53-9054-82ac41975404: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-654dd6ea-08a9-4a53-9054-82ac41975404', 'volume_size': 1}
Nov 05 15:15:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:15:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-43f96ec6-4fbc-4cc8-b18f-2914d4238ee1 tempest-TestInstancesWithCinderVolumes-1687340720 None] Acquiring lock "cinder-8a0ae42f-7eca-4150-a9bc-c4be12414c53-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:15:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-43f96ec6-4fbc-4cc8-b18f-2914d4238ee1 tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "cinder-8a0ae42f-7eca-4150-a9bc-c4be12414c53-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:15:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-43f96ec6-4fbc-4cc8-b18f-2914d4238ee1 tempest-TestInstancesWithCinderVolumes-1687340720 None] Acquiring lock "cinder-quobyte-8a0ae42f-7eca-4150-a9bc-c4be12414c53" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:15:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-43f96ec6-4fbc-4cc8-b18f-2914d4238ee1 tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "cinder-quobyte-8a0ae42f-7eca-4150-a9bc-c4be12414c53" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:15:56 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:56 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20b67cc-415a-4aea-9076-f873153bccee]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:15:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-43f96ec6-4fbc-4cc8-b18f-2914d4238ee1 tempest-TestInstancesWithCinderVolumes-1687340720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8a0ae42f-7eca-4150-a9bc-c4be12414c53 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-13975b62-f6ec-4cf0-ba69-90f0ba9e6ea2 tempest-SnapshotsActionsTest-1456956290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b 1G" returned: 0 in 0.514s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-13975b62-f6ec-4cf0-ba69-90f0ba9e6ea2 tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa6b6e28-073d-4e76-8acb-82534904a72e -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:56 devstack sudo[101467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa6b6e28-073d-4e76-8acb-82534904a72e -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b
Nov 05 15:15:56 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:56 devstack sudo[101466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8a0ae42f-7eca-4150-a9bc-c4be12414c53
Nov 05 15:15:56 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:57 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-13975b62-f6ec-4cf0-ba69-90f0ba9e6ea2 tempest-SnapshotsActionsTest-1456956290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa6b6e28-073d-4e76-8acb-82534904a72e -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b" returned: 0 in 0.324s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:57 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-13975b62-f6ec-4cf0-ba69-90f0ba9e6ea2 tempest-SnapshotsActionsTest-1456956290 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b is being set with open permissions: ugo+rw
Nov 05 15:15:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-13975b62-f6ec-4cf0-ba69-90f0ba9e6ea2 tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:57 devstack sudo[101475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b
Nov 05 15:15:57 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:57 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-43f96ec6-4fbc-4cc8-b18f-2914d4238ee1 tempest-TestInstancesWithCinderVolumes-1687340720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8a0ae42f-7eca-4150-a9bc-c4be12414c53" returned: 0 in 0.431s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-43f96ec6-4fbc-4cc8-b18f-2914d4238ee1 tempest-TestInstancesWithCinderVolumes-1687340720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8a0ae42f-7eca-4150-a9bc-c4be12414c53 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:57 devstack sudo[101478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8a0ae42f-7eca-4150-a9bc-c4be12414c53
Nov 05 15:15:57 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:57 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-13975b62-f6ec-4cf0-ba69-90f0ba9e6ea2 tempest-SnapshotsActionsTest-1456956290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b" returned: 0 in 0.276s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-13975b62-f6ec-4cf0-ba69-90f0ba9e6ea2 tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:57 devstack sudo[101482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.info
Nov 05 15:15:57 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:57 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-43f96ec6-4fbc-4cc8-b18f-2914d4238ee1 tempest-TestInstancesWithCinderVolumes-1687340720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8a0ae42f-7eca-4150-a9bc-c4be12414c53" returned: 0 in 0.267s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-43f96ec6-4fbc-4cc8-b18f-2914d4238ee1 tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "cinder-quobyte-8a0ae42f-7eca-4150-a9bc-c4be12414c53" released by "delete_volume" :: held 0.771s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:15:57 devstack cinder-volume[87150]: WARNING cinder.quota [None req-43f96ec6-4fbc-4cc8-b18f-2914d4238ee1 tempest-TestInstancesWithCinderVolumes-1687340720 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1679057473-1210824439 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1679057473-1210824439, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:15:57 devstack cinder-volume[87150]: WARNING cinder.quota [None req-43f96ec6-4fbc-4cc8-b18f-2914d4238ee1 tempest-TestInstancesWithCinderVolumes-1687340720 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1679057473-1210824439 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1679057473-1210824439, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:15:57 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-43f96ec6-4fbc-4cc8-b18f-2914d4238ee1 tempest-TestInstancesWithCinderVolumes-1687340720 None] Created reservations ['732026ca-59a7-4de7-a72a-ec43660788b1', '21f80cde-be2c-43d5-b7c5-c4095ddb7300', '635125fb-1adb-4dd2-aa57-7da51cd34bf9', 'b237dc9d-f8e8-44b5-9bf2-bb1c7acde34a'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:15:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-43f96ec6-4fbc-4cc8-b18f-2914d4238ee1 tempest-TestInstancesWithCinderVolumes-1687340720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:15:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-43f96ec6-4fbc-4cc8-b18f-2914d4238ee1 tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:15:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-43f96ec6-4fbc-4cc8-b18f-2914d4238ee1 tempest-TestInstancesWithCinderVolumes-1687340720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:15:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-43f96ec6-4fbc-4cc8-b18f-2914d4238ee1 tempest-TestInstancesWithCinderVolumes-1687340720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:15:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-43f96ec6-4fbc-4cc8-b18f-2914d4238ee1 tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:15:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-43f96ec6-4fbc-4cc8-b18f-2914d4238ee1 tempest-TestInstancesWithCinderVolumes-1687340720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:57 devstack sudo[101484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:15:57 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:57 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-13975b62-f6ec-4cf0-ba69-90f0ba9e6ea2 tempest-SnapshotsActionsTest-1456956290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.info" returned: 0 in 0.307s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:57 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-13975b62-f6ec-4cf0-ba69-90f0ba9e6ea2 tempest-SnapshotsActionsTest-1456956290 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.info is being set with open permissions: ugo+rw
Nov 05 15:15:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-13975b62-f6ec-4cf0-ba69-90f0ba9e6ea2 tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:57 devstack sudo[101487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.info
Nov 05 15:15:57 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:57 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-43f96ec6-4fbc-4cc8-b18f-2914d4238ee1 tempest-TestInstancesWithCinderVolumes-1687340720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.295s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:57 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-43f96ec6-4fbc-4cc8-b18f-2914d4238ee1 tempest-TestInstancesWithCinderVolumes-1687340720 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:15:57 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-43f96ec6-4fbc-4cc8-b18f-2914d4238ee1 tempest-TestInstancesWithCinderVolumes-1687340720 None] Deleted volume successfully.
Nov 05 15:15:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-43f96ec6-4fbc-4cc8-b18f-2914d4238ee1 tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "cinder-8a0ae42f-7eca-4150-a9bc-c4be12414c53-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:15:58 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-13975b62-f6ec-4cf0-ba69-90f0ba9e6ea2 tempest-SnapshotsActionsTest-1456956290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.info" returned: 0 in 0.317s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-13975b62-f6ec-4cf0-ba69-90f0ba9e6ea2 tempest-SnapshotsActionsTest-1456956290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.302s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:15:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.721s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:15:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-961006592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654dd6ea-08a9-4a53-9054-82ac41975404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebd5bd8e01ba4c0fb7fc29b74c991796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:56Z,use_quota=True,user_id='73262e81d97b4c40842ec92f7e44d3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:15:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Creating volume 654dd6ea-08a9-4a53-9054-82ac41975404 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:15:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:15:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:15:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:15:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:15:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:15:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:15:58 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:15:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-654dd6ea-08a9-4a53-9054-82ac41975404 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:58 devstack sudo[101492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-654dd6ea-08a9-4a53-9054-82ac41975404 1073741824
Nov 05 15:15:58 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:58 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-13975b62-f6ec-4cf0-ba69-90f0ba9e6ea2 tempest-SnapshotsActionsTest-1456956290 None] Create snapshot completed successfully
Nov 05 15:15:58 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-654dd6ea-08a9-4a53-9054-82ac41975404 1073741824" returned: 0 in 0.506s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-654dd6ea-08a9-4a53-9054-82ac41975404 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:15:58 devstack sudo[101498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-654dd6ea-08a9-4a53-9054-82ac41975404
Nov 05 15:15:58 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:15:58 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root
Nov 05 15:15:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-654dd6ea-08a9-4a53-9054-82ac41975404" returned: 0 in 0.268s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:15:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:15:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:15:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4083954a-2989-4fef-9a68-afbda89a13f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-654dd6ea-08a9-4a53-9054-82ac41975404', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:15:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce83cba4-0ea0-411d-a644-eee151d3d160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:15:59 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Volume volume-654dd6ea-08a9-4a53-9054-82ac41975404 (654dd6ea-08a9-4a53-9054-82ac41975404): created successfully
Nov 05 15:15:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce83cba4-0ea0-411d-a644-eee151d3d160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:15:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Flow 'volume_create_manager' (7ddac09f-69f2-4623-98fc-4263db3791cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:15:59 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e813f6ab-94c5-4338-a638-3361289a7d6b tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Created volume successfully.
Nov 05 15:15:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5d1f5c37-da0d-4cdd-805b-1ceb9c54b6be tempest-SnapshotsActionsTest-1456956290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:15:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5d1f5c37-da0d-4cdd-805b-1ceb9c54b6be tempest-SnapshotsActionsTest-1456956290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:15:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-5d1f5c37-da0d-4cdd-805b-1ceb9c54b6be tempest-SnapshotsActionsTest-1456956290 None] Creating offline snapshot 89fb12da-726c-42ab-9caf-6015cd6ff15c of volume fa6b6e28-073d-4e76-8acb-82534904a72e {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:16:00 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b777c1-2544-4a19-a7c3-a9ad2280306e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:16:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d1f5c37-da0d-4cdd-805b-1ceb9c54b6be tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:00 devstack sudo[101527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b
Nov 05 15:16:00 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:00 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d1f5c37-da0d-4cdd-805b-1ceb9c54b6be tempest-SnapshotsActionsTest-1456956290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b" returned: 0 in 0.516s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-5d1f5c37-da0d-4cdd-805b-1ceb9c54b6be tempest-SnapshotsActionsTest-1456956290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa6b6e28-073d-4e76-8acb-82534904a72e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:16:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d1f5c37-da0d-4cdd-805b-1ceb9c54b6be tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.89fb12da-726c-42ab-9caf-6015cd6ff15c 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:00 devstack sudo[101539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.89fb12da-726c-42ab-9caf-6015cd6ff15c 1G
Nov 05 15:16:00 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-2ee95bdb-5e70-4a04-956b-6939bf522b0b req-3dbb53b3-73f4-46cf-b746-43ad3b5bc547 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:16:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-4824193d-1d35-464c-ae21-c9f0fe3e553e req-79739710-a997-4d08-a724-e13c3262d4f1 tempest-TestInstancesWithCinderVolumes-1687340720 None] Terminate volume connection completed successfully.
Nov 05 15:16:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-4824193d-1d35-464c-ae21-c9f0fe3e553e req-79739710-a997-4d08-a724-e13c3262d4f1 tempest-TestInstancesWithCinderVolumes-1687340720 None] Deleting attachment f3e9da6b-cc42-4663-a9c6-564d0dbaf3d6. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 15:16:01 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d1f5c37-da0d-4cdd-805b-1ceb9c54b6be tempest-SnapshotsActionsTest-1456956290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.89fb12da-726c-42ab-9caf-6015cd6ff15c 1G" returned: 0 in 0.626s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d1f5c37-da0d-4cdd-805b-1ceb9c54b6be tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.89fb12da-726c-42ab-9caf-6015cd6ff15c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:01 devstack sudo[101548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.89fb12da-726c-42ab-9caf-6015cd6ff15c
Nov 05 15:16:01 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:01 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d1f5c37-da0d-4cdd-805b-1ceb9c54b6be tempest-SnapshotsActionsTest-1456956290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.89fb12da-726c-42ab-9caf-6015cd6ff15c" returned: 0 in 0.312s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:01 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-5d1f5c37-da0d-4cdd-805b-1ceb9c54b6be tempest-SnapshotsActionsTest-1456956290 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.89fb12da-726c-42ab-9caf-6015cd6ff15c is being set with open permissions: ugo+rw
Nov 05 15:16:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d1f5c37-da0d-4cdd-805b-1ceb9c54b6be tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.89fb12da-726c-42ab-9caf-6015cd6ff15c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:01 devstack sudo[101553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.89fb12da-726c-42ab-9caf-6015cd6ff15c
Nov 05 15:16:01 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:01 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d1f5c37-da0d-4cdd-805b-1ceb9c54b6be tempest-SnapshotsActionsTest-1456956290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.89fb12da-726c-42ab-9caf-6015cd6ff15c" returned: 0 in 0.290s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5d1f5c37-da0d-4cdd-805b-1ceb9c54b6be tempest-SnapshotsActionsTest-1456956290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.922s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:16:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-2ee95bdb-5e70-4a04-956b-6939bf522b0b req-3dbb53b3-73f4-46cf-b746-43ad3b5bc547 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.990s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:16:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-2ee95bdb-5e70-4a04-956b-6939bf522b0b req-3dbb53b3-73f4-46cf-b746-43ad3b5bc547 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:16:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5d1f5c37-da0d-4cdd-805b-1ceb9c54b6be tempest-SnapshotsActionsTest-1456956290 None] Create snapshot completed successfully
Nov 05 15:16:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-2ee95bdb-5e70-4a04-956b-6939bf522b0b req-3dbb53b3-73f4-46cf-b746-43ad3b5bc547 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628', 'name': 'volume-654dd6ea-08a9-4a53-9054-82ac41975404', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e7084ef-6895-4aa8-a1b9-0c016ad4645a', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 15:16:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-2ee95bdb-5e70-4a04-956b-6939bf522b0b req-3dbb53b3-73f4-46cf-b746-43ad3b5bc547 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] attachment_update completed successfully.
Nov 05 15:16:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-829a5c0d-aeae-4a81-afdb-038fc5dfb689 tempest-TestInstancesWithCinderVolumes-1687340720 None] Acquiring lock "cinder-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:16:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-829a5c0d-aeae-4a81-afdb-038fc5dfb689 tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "cinder-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:16:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-829a5c0d-aeae-4a81-afdb-038fc5dfb689 tempest-TestInstancesWithCinderVolumes-1687340720 None] Acquiring lock "cinder-quobyte-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:16:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-829a5c0d-aeae-4a81-afdb-038fc5dfb689 tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "cinder-quobyte-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:16:02 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3d32d4-f6f4-4436-a3a0-31ddc2072613]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:16:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-829a5c0d-aeae-4a81-afdb-038fc5dfb689 tempest-TestInstancesWithCinderVolumes-1687340720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b08b4e53-5237-41a3-8723-fc33c29840f2 tempest-SnapshotsActionsTest-1282414551 None] Acquiring lock "cinder-89fb12da-726c-42ab-9caf-6015cd6ff15c-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:16:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b08b4e53-5237-41a3-8723-fc33c29840f2 tempest-SnapshotsActionsTest-1282414551 None] Lock "cinder-89fb12da-726c-42ab-9caf-6015cd6ff15c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:16:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b08b4e53-5237-41a3-8723-fc33c29840f2 tempest-SnapshotsActionsTest-1282414551 None] Acquiring lock "cinder-quobyte-fa6b6e28-073d-4e76-8acb-82534904a72e" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:16:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b08b4e53-5237-41a3-8723-fc33c29840f2 tempest-SnapshotsActionsTest-1282414551 None] Lock "cinder-quobyte-fa6b6e28-073d-4e76-8acb-82534904a72e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:16:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b08b4e53-5237-41a3-8723-fc33c29840f2 tempest-SnapshotsActionsTest-1282414551 None] Acquiring lock "cinder-quobyte-89fb12da-726c-42ab-9caf-6015cd6ff15c" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:16:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b08b4e53-5237-41a3-8723-fc33c29840f2 tempest-SnapshotsActionsTest-1282414551 None] Lock "cinder-quobyte-89fb12da-726c-42ab-9caf-6015cd6ff15c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:16:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b08b4e53-5237-41a3-8723-fc33c29840f2 tempest-SnapshotsActionsTest-1282414551 None] Deleting offline snapshot 89fb12da-726c-42ab-9caf-6015cd6ff15c of volume fa6b6e28-073d-4e76-8acb-82534904a72e {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:16:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b08b4e53-5237-41a3-8723-fc33c29840f2 tempest-SnapshotsActionsTest-1282414551 None] snapshot_file for this snap is: volume-fa6b6e28-073d-4e76-8acb-82534904a72e.89fb12da-726c-42ab-9caf-6015cd6ff15c {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:16:02 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[52964075-d2cb-4330-9063-a66cfda17c8f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:16:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b08b4e53-5237-41a3-8723-fc33c29840f2 tempest-SnapshotsActionsTest-1282414551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.89fb12da-726c-42ab-9caf-6015cd6ff15c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:02 devstack sudo[101613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c
Nov 05 15:16:02 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:02 devstack sudo[101658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.89fb12da-726c-42ab-9caf-6015cd6ff15c
Nov 05 15:16:02 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:02 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-829a5c0d-aeae-4a81-afdb-038fc5dfb689 tempest-TestInstancesWithCinderVolumes-1687340720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c" returned: 0 in 0.515s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-829a5c0d-aeae-4a81-afdb-038fc5dfb689 tempest-TestInstancesWithCinderVolumes-1687340720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:02 devstack sudo[101977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c
Nov 05 15:16:02 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:02 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b08b4e53-5237-41a3-8723-fc33c29840f2 tempest-SnapshotsActionsTest-1282414551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.89fb12da-726c-42ab-9caf-6015cd6ff15c" returned: 0 in 0.484s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b08b4e53-5237-41a3-8723-fc33c29840f2 tempest-SnapshotsActionsTest-1282414551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa6b6e28-073d-4e76-8acb-82534904a72e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:16:02 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b69e492-bef9-47aa-8d24-be4ba8474eba]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:16:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b08b4e53-5237-41a3-8723-fc33c29840f2 tempest-SnapshotsActionsTest-1282414551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:02 devstack sudo[101982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b
Nov 05 15:16:02 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:02 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-829a5c0d-aeae-4a81-afdb-038fc5dfb689 tempest-TestInstancesWithCinderVolumes-1687340720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c" returned: 0 in 0.283s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-829a5c0d-aeae-4a81-afdb-038fc5dfb689 tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "cinder-quobyte-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c" released by "delete_volume" :: held 0.861s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:16:03 devstack cinder-volume[87150]: WARNING cinder.quota [None req-829a5c0d-aeae-4a81-afdb-038fc5dfb689 tempest-TestInstancesWithCinderVolumes-1687340720 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-921461963-1559364657 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-921461963-1559364657, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:16:03 devstack cinder-volume[87150]: WARNING cinder.quota [None req-829a5c0d-aeae-4a81-afdb-038fc5dfb689 tempest-TestInstancesWithCinderVolumes-1687340720 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-921461963-1559364657 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-921461963-1559364657, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:16:03 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-829a5c0d-aeae-4a81-afdb-038fc5dfb689 tempest-TestInstancesWithCinderVolumes-1687340720 None] Created reservations ['67c044d9-2f3a-4a1d-8157-8ef55526edef', '52eeb927-9dc1-4fbf-810f-90359afa960b', '7a20f911-01dc-41a0-a8c3-2528ca37138e', 'aa4c8292-f622-4e58-97fd-71ab154e01eb'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:16:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-829a5c0d-aeae-4a81-afdb-038fc5dfb689 tempest-TestInstancesWithCinderVolumes-1687340720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:16:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-829a5c0d-aeae-4a81-afdb-038fc5dfb689 tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:16:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-829a5c0d-aeae-4a81-afdb-038fc5dfb689 tempest-TestInstancesWithCinderVolumes-1687340720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:16:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-829a5c0d-aeae-4a81-afdb-038fc5dfb689 tempest-TestInstancesWithCinderVolumes-1687340720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:16:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-829a5c0d-aeae-4a81-afdb-038fc5dfb689 tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:16:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-829a5c0d-aeae-4a81-afdb-038fc5dfb689 tempest-TestInstancesWithCinderVolumes-1687340720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:03 devstack sudo[101985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:16:03 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:03 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b08b4e53-5237-41a3-8723-fc33c29840f2 tempest-SnapshotsActionsTest-1282414551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b" returned: 0 in 0.405s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b08b4e53-5237-41a3-8723-fc33c29840f2 tempest-SnapshotsActionsTest-1282414551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa6b6e28-073d-4e76-8acb-82534904a72e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:16:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b08b4e53-5237-41a3-8723-fc33c29840f2 tempest-SnapshotsActionsTest-1282414551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.89fb12da-726c-42ab-9caf-6015cd6ff15c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:03 devstack sudo[101991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.89fb12da-726c-42ab-9caf-6015cd6ff15c
Nov 05 15:16:03 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:03 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-829a5c0d-aeae-4a81-afdb-038fc5dfb689 tempest-TestInstancesWithCinderVolumes-1687340720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.281s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:03 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-829a5c0d-aeae-4a81-afdb-038fc5dfb689 tempest-TestInstancesWithCinderVolumes-1687340720 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:16:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-829a5c0d-aeae-4a81-afdb-038fc5dfb689 tempest-TestInstancesWithCinderVolumes-1687340720 None] Deleted volume successfully.
Nov 05 15:16:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-829a5c0d-aeae-4a81-afdb-038fc5dfb689 tempest-TestInstancesWithCinderVolumes-1687340720 None] Lock "cinder-aa2c572b-d9c7-4bcd-9109-9a7ff44a864c-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:16:03 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b08b4e53-5237-41a3-8723-fc33c29840f2 tempest-SnapshotsActionsTest-1282414551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.89fb12da-726c-42ab-9caf-6015cd6ff15c" returned: 0 in 0.425s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b08b4e53-5237-41a3-8723-fc33c29840f2 tempest-SnapshotsActionsTest-1282414551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.89fb12da-726c-42ab-9caf-6015cd6ff15c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:03 devstack sudo[101998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.89fb12da-726c-42ab-9caf-6015cd6ff15c
Nov 05 15:16:03 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:03 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b08b4e53-5237-41a3-8723-fc33c29840f2 tempest-SnapshotsActionsTest-1282414551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.89fb12da-726c-42ab-9caf-6015cd6ff15c" returned: 0 in 0.280s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b08b4e53-5237-41a3-8723-fc33c29840f2 tempest-SnapshotsActionsTest-1282414551 None] Lock "cinder-quobyte-89fb12da-726c-42ab-9caf-6015cd6ff15c" released by "_delete_snapshot" :: held 1.741s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:16:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b08b4e53-5237-41a3-8723-fc33c29840f2 tempest-SnapshotsActionsTest-1282414551 None] Lock "cinder-quobyte-fa6b6e28-073d-4e76-8acb-82534904a72e" released by "delete_snapshot" :: held 1.773s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:16:04 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b08b4e53-5237-41a3-8723-fc33c29840f2 tempest-SnapshotsActionsTest-1282414551 None] Created reservations ['8a32ad76-eb8c-4da8-b781-d5f7bae057c0', '9df6c822-cfd4-406c-9269-7acc22a89ac1', '23b399c3-d989-41fe-a733-d3182bde6a89', '56e02b2e-7bdf-4c0b-ba44-94c556772b21'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:16:04 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b08b4e53-5237-41a3-8723-fc33c29840f2 tempest-SnapshotsActionsTest-1282414551 None] Delete snapshot completed successfully.
Nov 05 15:16:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b08b4e53-5237-41a3-8723-fc33c29840f2 tempest-SnapshotsActionsTest-1282414551 None] Lock "cinder-89fb12da-726c-42ab-9caf-6015cd6ff15c-delete_snapshot" released by "delete_snapshot" :: held 1.933s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:16:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cf70614a-2931-410d-a172-98a6549f6cf4 tempest-SnapshotsActionsTest-1456956290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:16:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cf70614a-2931-410d-a172-98a6549f6cf4 tempest-SnapshotsActionsTest-1456956290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:16:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-cf70614a-2931-410d-a172-98a6549f6cf4 tempest-SnapshotsActionsTest-1456956290 None] Creating offline snapshot a2435085-93b0-41a7-9a71-027098dcdca8 of volume fa6b6e28-073d-4e76-8acb-82534904a72e {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:16:04 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[49990cac-d079-4a4e-b158-5ffc0f8a91ae]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:16:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf70614a-2931-410d-a172-98a6549f6cf4 tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:05 devstack sudo[102001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b
Nov 05 15:16:05 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:05 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf70614a-2931-410d-a172-98a6549f6cf4 tempest-SnapshotsActionsTest-1456956290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b" returned: 0 in 0.406s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-cf70614a-2931-410d-a172-98a6549f6cf4 tempest-SnapshotsActionsTest-1456956290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa6b6e28-073d-4e76-8acb-82534904a72e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:16:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf70614a-2931-410d-a172-98a6549f6cf4 tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.a2435085-93b0-41a7-9a71-027098dcdca8 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:05 devstack sudo[102006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.a2435085-93b0-41a7-9a71-027098dcdca8 1G
Nov 05 15:16:05 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:05 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-0679cd12-d84d-4848-8c82-8f1a02e18a92 req-685cea6d-4512-4d7f-92f6-937e6d7f7aa2 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Terminate volume connection completed successfully.
Nov 05 15:16:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-0679cd12-d84d-4848-8c82-8f1a02e18a92 req-685cea6d-4512-4d7f-92f6-937e6d7f7aa2 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Deleting attachment 2e7084ef-6895-4aa8-a1b9-0c016ad4645a. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 15:16:05 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf70614a-2931-410d-a172-98a6549f6cf4 tempest-SnapshotsActionsTest-1456956290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.a2435085-93b0-41a7-9a71-027098dcdca8 1G" returned: 0 in 0.555s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf70614a-2931-410d-a172-98a6549f6cf4 tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.a2435085-93b0-41a7-9a71-027098dcdca8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:05 devstack sudo[102039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.a2435085-93b0-41a7-9a71-027098dcdca8
Nov 05 15:16:05 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:06 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf70614a-2931-410d-a172-98a6549f6cf4 tempest-SnapshotsActionsTest-1456956290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.a2435085-93b0-41a7-9a71-027098dcdca8" returned: 0 in 0.329s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:06 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-cf70614a-2931-410d-a172-98a6549f6cf4 tempest-SnapshotsActionsTest-1456956290 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.a2435085-93b0-41a7-9a71-027098dcdca8 is being set with open permissions: ugo+rw
Nov 05 15:16:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf70614a-2931-410d-a172-98a6549f6cf4 tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.a2435085-93b0-41a7-9a71-027098dcdca8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:06 devstack sudo[102044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.a2435085-93b0-41a7-9a71-027098dcdca8
Nov 05 15:16:06 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b556acea-e5a0-4548-a0fb-0b3151ea9004 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Acquiring lock "cinder-654dd6ea-08a9-4a53-9054-82ac41975404-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:16:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b556acea-e5a0-4548-a0fb-0b3151ea9004 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Lock "cinder-654dd6ea-08a9-4a53-9054-82ac41975404-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:16:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b556acea-e5a0-4548-a0fb-0b3151ea9004 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Acquiring lock "cinder-quobyte-654dd6ea-08a9-4a53-9054-82ac41975404" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:16:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b556acea-e5a0-4548-a0fb-0b3151ea9004 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Lock "cinder-quobyte-654dd6ea-08a9-4a53-9054-82ac41975404" acquired by "delete_volume" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:16:06 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf70614a-2931-410d-a172-98a6549f6cf4 tempest-SnapshotsActionsTest-1456956290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.a2435085-93b0-41a7-9a71-027098dcdca8" returned: 0 in 0.276s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:06 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0009414-dda8-4297-961d-1aed76c77a8f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:16:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b556acea-e5a0-4548-a0fb-0b3151ea9004 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-654dd6ea-08a9-4a53-9054-82ac41975404 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cf70614a-2931-410d-a172-98a6549f6cf4 tempest-SnapshotsActionsTest-1456956290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.748s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:16:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-cf70614a-2931-410d-a172-98a6549f6cf4 tempest-SnapshotsActionsTest-1456956290 None] Create snapshot completed successfully
Nov 05 15:16:06 devstack sudo[102047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-654dd6ea-08a9-4a53-9054-82ac41975404
Nov 05 15:16:06 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:06 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b556acea-e5a0-4548-a0fb-0b3151ea9004 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-654dd6ea-08a9-4a53-9054-82ac41975404" returned: 0 in 0.405s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b556acea-e5a0-4548-a0fb-0b3151ea9004 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-654dd6ea-08a9-4a53-9054-82ac41975404 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:06 devstack sudo[102052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-654dd6ea-08a9-4a53-9054-82ac41975404
Nov 05 15:16:06 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-addc3a45-89da-4155-800a-35d30bac458e tempest-SnapshotsActionsTest-1282414551 None] Acquiring lock "cinder-a2435085-93b0-41a7-9a71-027098dcdca8-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-addc3a45-89da-4155-800a-35d30bac458e tempest-SnapshotsActionsTest-1282414551 None] Lock "cinder-a2435085-93b0-41a7-9a71-027098dcdca8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-addc3a45-89da-4155-800a-35d30bac458e tempest-SnapshotsActionsTest-1282414551 None] Acquiring lock "cinder-quobyte-fa6b6e28-073d-4e76-8acb-82534904a72e" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-addc3a45-89da-4155-800a-35d30bac458e tempest-SnapshotsActionsTest-1282414551 None] Lock "cinder-quobyte-fa6b6e28-073d-4e76-8acb-82534904a72e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-addc3a45-89da-4155-800a-35d30bac458e tempest-SnapshotsActionsTest-1282414551 None] Acquiring lock "cinder-quobyte-a2435085-93b0-41a7-9a71-027098dcdca8" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-addc3a45-89da-4155-800a-35d30bac458e tempest-SnapshotsActionsTest-1282414551 None] Lock "cinder-quobyte-a2435085-93b0-41a7-9a71-027098dcdca8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-addc3a45-89da-4155-800a-35d30bac458e tempest-SnapshotsActionsTest-1282414551 None] Deleting offline snapshot a2435085-93b0-41a7-9a71-027098dcdca8 of volume fa6b6e28-073d-4e76-8acb-82534904a72e {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-addc3a45-89da-4155-800a-35d30bac458e tempest-SnapshotsActionsTest-1282414551 None] snapshot_file for this snap is: volume-fa6b6e28-073d-4e76-8acb-82534904a72e.a2435085-93b0-41a7-9a71-027098dcdca8 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[56447d10-b2f3-4aee-bc39-aab86ffde7b4]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-addc3a45-89da-4155-800a-35d30bac458e tempest-SnapshotsActionsTest-1282414551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.a2435085-93b0-41a7-9a71-027098dcdca8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:07 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b556acea-e5a0-4548-a0fb-0b3151ea9004 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-654dd6ea-08a9-4a53-9054-82ac41975404" returned: 0 in 0.256s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b556acea-e5a0-4548-a0fb-0b3151ea9004 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Lock "cinder-quobyte-654dd6ea-08a9-4a53-9054-82ac41975404" released by "delete_volume" :: held 0.715s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b556acea-e5a0-4548-a0fb-0b3151ea9004 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Created reservations ['9726bd01-a6d1-429e-a24f-6531f1102daa', '3d50c10a-fd6a-4b62-8bbc-c605c6dc3901', 'c4c0cb29-a9d4-476e-a663-efa1a3fdc748', 'e8ad8172-75f3-4fba-8798-7ad7fcaf5556'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:16:07 devstack sudo[102055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.a2435085-93b0-41a7-9a71-027098dcdca8
Nov 05 15:16:07 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b556acea-e5a0-4548-a0fb-0b3151ea9004 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b556acea-e5a0-4548-a0fb-0b3151ea9004 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b556acea-e5a0-4548-a0fb-0b3151ea9004 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b556acea-e5a0-4548-a0fb-0b3151ea9004 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b556acea-e5a0-4548-a0fb-0b3151ea9004 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b556acea-e5a0-4548-a0fb-0b3151ea9004 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:07 devstack sudo[102057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:16:07 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:07 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-addc3a45-89da-4155-800a-35d30bac458e tempest-SnapshotsActionsTest-1282414551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.a2435085-93b0-41a7-9a71-027098dcdca8" returned: 0 in 0.380s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-addc3a45-89da-4155-800a-35d30bac458e tempest-SnapshotsActionsTest-1282414551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa6b6e28-073d-4e76-8acb-82534904a72e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:16:07 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b556acea-e5a0-4548-a0fb-0b3151ea9004 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.283s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-b556acea-e5a0-4548-a0fb-0b3151ea9004 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aeb5352-8294-4fec-816f-952144a8e802]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-addc3a45-89da-4155-800a-35d30bac458e tempest-SnapshotsActionsTest-1282414551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:07 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b556acea-e5a0-4548-a0fb-0b3151ea9004 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Deleted volume successfully.
Nov 05 15:16:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b556acea-e5a0-4548-a0fb-0b3151ea9004 tempest-TestServerVolumeAttachScenarioOldVersion-1173536903 None] Lock "cinder-654dd6ea-08a9-4a53-9054-82ac41975404-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:16:07 devstack sudo[102063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b
Nov 05 15:16:07 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:08 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-addc3a45-89da-4155-800a-35d30bac458e tempest-SnapshotsActionsTest-1282414551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b" returned: 0 in 0.543s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-addc3a45-89da-4155-800a-35d30bac458e tempest-SnapshotsActionsTest-1282414551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa6b6e28-073d-4e76-8acb-82534904a72e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:16:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-addc3a45-89da-4155-800a-35d30bac458e tempest-SnapshotsActionsTest-1282414551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.a2435085-93b0-41a7-9a71-027098dcdca8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:08 devstack sudo[102070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.a2435085-93b0-41a7-9a71-027098dcdca8
Nov 05 15:16:08 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:08 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-addc3a45-89da-4155-800a-35d30bac458e tempest-SnapshotsActionsTest-1282414551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.a2435085-93b0-41a7-9a71-027098dcdca8" returned: 0 in 0.646s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-addc3a45-89da-4155-800a-35d30bac458e tempest-SnapshotsActionsTest-1282414551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.a2435085-93b0-41a7-9a71-027098dcdca8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:08 devstack sudo[102099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.a2435085-93b0-41a7-9a71-027098dcdca8
Nov 05 15:16:08 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:09 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-addc3a45-89da-4155-800a-35d30bac458e tempest-SnapshotsActionsTest-1282414551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.a2435085-93b0-41a7-9a71-027098dcdca8" returned: 0 in 0.293s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-addc3a45-89da-4155-800a-35d30bac458e tempest-SnapshotsActionsTest-1282414551 None] Lock "cinder-quobyte-a2435085-93b0-41a7-9a71-027098dcdca8" released by "_delete_snapshot" :: held 2.011s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:16:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-addc3a45-89da-4155-800a-35d30bac458e tempest-SnapshotsActionsTest-1282414551 None] Lock "cinder-quobyte-fa6b6e28-073d-4e76-8acb-82534904a72e" released by "delete_snapshot" :: held 2.044s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:16:09 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-addc3a45-89da-4155-800a-35d30bac458e tempest-SnapshotsActionsTest-1282414551 None] Created reservations ['d81a062d-a880-456e-b640-af72d684aabe', 'b4e4809b-431b-41bf-bbbf-d1a8ea632676', 'c2765502-345c-43bb-bf02-6af00285a1b1', '8cc70db4-ecbe-4ccf-9cd1-10cd806e56f5'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:16:09 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-addc3a45-89da-4155-800a-35d30bac458e tempest-SnapshotsActionsTest-1282414551 None] Delete snapshot completed successfully.
Nov 05 15:16:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-addc3a45-89da-4155-800a-35d30bac458e tempest-SnapshotsActionsTest-1282414551 None] Lock "cinder-a2435085-93b0-41a7-9a71-027098dcdca8-delete_snapshot" released by "delete_snapshot" :: held 2.270s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:16:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-602f4958-3d94-4027-a4e1-ffac967117f2 tempest-SnapshotsActionsTest-1456956290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:16:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-602f4958-3d94-4027-a4e1-ffac967117f2 tempest-SnapshotsActionsTest-1456956290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:16:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-602f4958-3d94-4027-a4e1-ffac967117f2 tempest-SnapshotsActionsTest-1456956290 None] Creating offline snapshot 1330c591-3ef0-4c7e-ba1f-34190f337446 of volume fa6b6e28-073d-4e76-8acb-82534904a72e {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:16:10 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b50a681-3db1-4610-b673-1ad0025645c4]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:16:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-602f4958-3d94-4027-a4e1-ffac967117f2 tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:10 devstack sudo[102107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b
Nov 05 15:16:10 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:11 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-602f4958-3d94-4027-a4e1-ffac967117f2 tempest-SnapshotsActionsTest-1456956290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b" returned: 0 in 0.407s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-602f4958-3d94-4027-a4e1-ffac967117f2 tempest-SnapshotsActionsTest-1456956290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa6b6e28-073d-4e76-8acb-82534904a72e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:16:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-602f4958-3d94-4027-a4e1-ffac967117f2 tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1330c591-3ef0-4c7e-ba1f-34190f337446 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:11 devstack sudo[102113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1330c591-3ef0-4c7e-ba1f-34190f337446 1G
Nov 05 15:16:11 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:11 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-602f4958-3d94-4027-a4e1-ffac967117f2 tempest-SnapshotsActionsTest-1456956290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1330c591-3ef0-4c7e-ba1f-34190f337446 1G" returned: 0 in 0.573s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-602f4958-3d94-4027-a4e1-ffac967117f2 tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1330c591-3ef0-4c7e-ba1f-34190f337446 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:11 devstack sudo[102119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1330c591-3ef0-4c7e-ba1f-34190f337446
Nov 05 15:16:11 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:12 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-602f4958-3d94-4027-a4e1-ffac967117f2 tempest-SnapshotsActionsTest-1456956290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1330c591-3ef0-4c7e-ba1f-34190f337446" returned: 0 in 0.326s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:12 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-602f4958-3d94-4027-a4e1-ffac967117f2 tempest-SnapshotsActionsTest-1456956290 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1330c591-3ef0-4c7e-ba1f-34190f337446 is being set with open permissions: ugo+rw
Nov 05 15:16:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-602f4958-3d94-4027-a4e1-ffac967117f2 tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1330c591-3ef0-4c7e-ba1f-34190f337446 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:12 devstack sudo[102125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1330c591-3ef0-4c7e-ba1f-34190f337446
Nov 05 15:16:12 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:12 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-602f4958-3d94-4027-a4e1-ffac967117f2 tempest-SnapshotsActionsTest-1456956290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1330c591-3ef0-4c7e-ba1f-34190f337446" returned: 0 in 0.280s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-602f4958-3d94-4027-a4e1-ffac967117f2 tempest-SnapshotsActionsTest-1456956290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.734s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:16:12 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-602f4958-3d94-4027-a4e1-ffac967117f2 tempest-SnapshotsActionsTest-1456956290 None] Create snapshot completed successfully
Nov 05 15:16:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-190da716-241d-406b-bcef-4c7d37b97f97 tempest-SnapshotsActionsTest-1282414551 None] Acquiring lock "cinder-1330c591-3ef0-4c7e-ba1f-34190f337446-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:16:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-190da716-241d-406b-bcef-4c7d37b97f97 tempest-SnapshotsActionsTest-1282414551 None] Lock "cinder-1330c591-3ef0-4c7e-ba1f-34190f337446-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:16:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-190da716-241d-406b-bcef-4c7d37b97f97 tempest-SnapshotsActionsTest-1282414551 None] Acquiring lock "cinder-quobyte-fa6b6e28-073d-4e76-8acb-82534904a72e" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:16:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-190da716-241d-406b-bcef-4c7d37b97f97 tempest-SnapshotsActionsTest-1282414551 None] Lock "cinder-quobyte-fa6b6e28-073d-4e76-8acb-82534904a72e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:16:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-190da716-241d-406b-bcef-4c7d37b97f97 tempest-SnapshotsActionsTest-1282414551 None] Acquiring lock "cinder-quobyte-1330c591-3ef0-4c7e-ba1f-34190f337446" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:16:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-190da716-241d-406b-bcef-4c7d37b97f97 tempest-SnapshotsActionsTest-1282414551 None] Lock "cinder-quobyte-1330c591-3ef0-4c7e-ba1f-34190f337446" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:16:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-190da716-241d-406b-bcef-4c7d37b97f97 tempest-SnapshotsActionsTest-1282414551 None] Deleting offline snapshot 1330c591-3ef0-4c7e-ba1f-34190f337446 of volume fa6b6e28-073d-4e76-8acb-82534904a72e {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:16:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-190da716-241d-406b-bcef-4c7d37b97f97 tempest-SnapshotsActionsTest-1282414551 None] snapshot_file for this snap is: volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1330c591-3ef0-4c7e-ba1f-34190f337446 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:16:13 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[207ed135-4a7e-4518-ab8b-a678eb0aca35]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:16:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-190da716-241d-406b-bcef-4c7d37b97f97 tempest-SnapshotsActionsTest-1282414551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1330c591-3ef0-4c7e-ba1f-34190f337446 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:13 devstack sudo[102128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1330c591-3ef0-4c7e-ba1f-34190f337446
Nov 05 15:16:13 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:13 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-190da716-241d-406b-bcef-4c7d37b97f97 tempest-SnapshotsActionsTest-1282414551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1330c591-3ef0-4c7e-ba1f-34190f337446" returned: 0 in 0.450s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-190da716-241d-406b-bcef-4c7d37b97f97 tempest-SnapshotsActionsTest-1282414551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa6b6e28-073d-4e76-8acb-82534904a72e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:16:13 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd72fe7-1e24-4e9d-8108-ba0ec5a7ee86]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:16:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-190da716-241d-406b-bcef-4c7d37b97f97 tempest-SnapshotsActionsTest-1282414551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:13 devstack sudo[102134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b
Nov 05 15:16:13 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:14 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-190da716-241d-406b-bcef-4c7d37b97f97 tempest-SnapshotsActionsTest-1282414551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b" returned: 0 in 0.463s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-190da716-241d-406b-bcef-4c7d37b97f97 tempest-SnapshotsActionsTest-1282414551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa6b6e28-073d-4e76-8acb-82534904a72e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:16:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-190da716-241d-406b-bcef-4c7d37b97f97 tempest-SnapshotsActionsTest-1282414551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1330c591-3ef0-4c7e-ba1f-34190f337446 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:14 devstack sudo[102140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1330c591-3ef0-4c7e-ba1f-34190f337446
Nov 05 15:16:14 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:14 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-190da716-241d-406b-bcef-4c7d37b97f97 tempest-SnapshotsActionsTest-1282414551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1330c591-3ef0-4c7e-ba1f-34190f337446" returned: 0 in 0.496s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-190da716-241d-406b-bcef-4c7d37b97f97 tempest-SnapshotsActionsTest-1282414551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1330c591-3ef0-4c7e-ba1f-34190f337446 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:14 devstack sudo[102146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1330c591-3ef0-4c7e-ba1f-34190f337446
Nov 05 15:16:14 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:14 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-190da716-241d-406b-bcef-4c7d37b97f97 tempest-SnapshotsActionsTest-1282414551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1330c591-3ef0-4c7e-ba1f-34190f337446" returned: 0 in 0.306s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-190da716-241d-406b-bcef-4c7d37b97f97 tempest-SnapshotsActionsTest-1282414551 None] Lock "cinder-quobyte-1330c591-3ef0-4c7e-ba1f-34190f337446" released by "_delete_snapshot" :: held 1.868s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:16:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-190da716-241d-406b-bcef-4c7d37b97f97 tempest-SnapshotsActionsTest-1282414551 None] Lock "cinder-quobyte-fa6b6e28-073d-4e76-8acb-82534904a72e" released by "delete_snapshot" :: held 1.895s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:16:14 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-190da716-241d-406b-bcef-4c7d37b97f97 tempest-SnapshotsActionsTest-1282414551 None] Created reservations ['8558ad45-5ba8-4296-b335-c03fa651c198', '2425aded-09c8-4cd9-b2bf-c95b872dc090', '5e0c4d9c-6eb0-4d13-8d6f-1799a00b2281', 'd09d20a7-7a77-4ef6-9c03-47d099c96c81'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:16:15 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-190da716-241d-406b-bcef-4c7d37b97f97 tempest-SnapshotsActionsTest-1282414551 None] Delete snapshot completed successfully.
Nov 05 15:16:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-190da716-241d-406b-bcef-4c7d37b97f97 tempest-SnapshotsActionsTest-1282414551 None] Lock "cinder-1330c591-3ef0-4c7e-ba1f-34190f337446-delete_snapshot" released by "delete_snapshot" :: held 2.057s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:16:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-93d775c8-2387-4508-8fda-ad2f9b7970a1 tempest-SnapshotsActionsTest-1456956290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:16:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-93d775c8-2387-4508-8fda-ad2f9b7970a1 tempest-SnapshotsActionsTest-1456956290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:16:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-93d775c8-2387-4508-8fda-ad2f9b7970a1 tempest-SnapshotsActionsTest-1456956290 None] Creating offline snapshot 1402e9d0-9584-4c7a-89e0-72ef9d9f1308 of volume fa6b6e28-073d-4e76-8acb-82534904a72e {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:16:15 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff89af3-176b-4772-8499-a65924f0da51]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:16:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-93d775c8-2387-4508-8fda-ad2f9b7970a1 tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:15 devstack sudo[102151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b
Nov 05 15:16:15 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:16 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-93d775c8-2387-4508-8fda-ad2f9b7970a1 tempest-SnapshotsActionsTest-1456956290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b" returned: 0 in 0.435s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-93d775c8-2387-4508-8fda-ad2f9b7970a1 tempest-SnapshotsActionsTest-1456956290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa6b6e28-073d-4e76-8acb-82534904a72e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:16:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-93d775c8-2387-4508-8fda-ad2f9b7970a1 tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1402e9d0-9584-4c7a-89e0-72ef9d9f1308 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:16 devstack sudo[102156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1402e9d0-9584-4c7a-89e0-72ef9d9f1308 1G
Nov 05 15:16:16 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:16 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-93d775c8-2387-4508-8fda-ad2f9b7970a1 tempest-SnapshotsActionsTest-1456956290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1402e9d0-9584-4c7a-89e0-72ef9d9f1308 1G" returned: 0 in 0.571s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-93d775c8-2387-4508-8fda-ad2f9b7970a1 tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1402e9d0-9584-4c7a-89e0-72ef9d9f1308 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:16 devstack sudo[102162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1402e9d0-9584-4c7a-89e0-72ef9d9f1308
Nov 05 15:16:16 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:16 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-93d775c8-2387-4508-8fda-ad2f9b7970a1 tempest-SnapshotsActionsTest-1456956290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1402e9d0-9584-4c7a-89e0-72ef9d9f1308" returned: 0 in 0.312s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:16 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-93d775c8-2387-4508-8fda-ad2f9b7970a1 tempest-SnapshotsActionsTest-1456956290 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1402e9d0-9584-4c7a-89e0-72ef9d9f1308 is being set with open permissions: ugo+rw
Nov 05 15:16:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-93d775c8-2387-4508-8fda-ad2f9b7970a1 tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1402e9d0-9584-4c7a-89e0-72ef9d9f1308 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:16 devstack sudo[102167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1402e9d0-9584-4c7a-89e0-72ef9d9f1308
Nov 05 15:16:16 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:17 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-93d775c8-2387-4508-8fda-ad2f9b7970a1 tempest-SnapshotsActionsTest-1456956290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1402e9d0-9584-4c7a-89e0-72ef9d9f1308" returned: 0 in 0.348s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-93d775c8-2387-4508-8fda-ad2f9b7970a1 tempest-SnapshotsActionsTest-1456956290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.812s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:16:17 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-93d775c8-2387-4508-8fda-ad2f9b7970a1 tempest-SnapshotsActionsTest-1456956290 None] Create snapshot completed successfully
Nov 05 15:16:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-abb3f01f-c041-4efe-be09-9dfc7a0611af tempest-SnapshotsActionsTest-1282414551 None] Acquiring lock "cinder-1402e9d0-9584-4c7a-89e0-72ef9d9f1308-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:16:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-abb3f01f-c041-4efe-be09-9dfc7a0611af tempest-SnapshotsActionsTest-1282414551 None] Lock "cinder-1402e9d0-9584-4c7a-89e0-72ef9d9f1308-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:16:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-abb3f01f-c041-4efe-be09-9dfc7a0611af tempest-SnapshotsActionsTest-1282414551 None] Acquiring lock "cinder-quobyte-fa6b6e28-073d-4e76-8acb-82534904a72e" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:16:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-abb3f01f-c041-4efe-be09-9dfc7a0611af tempest-SnapshotsActionsTest-1282414551 None] Lock "cinder-quobyte-fa6b6e28-073d-4e76-8acb-82534904a72e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:16:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-abb3f01f-c041-4efe-be09-9dfc7a0611af tempest-SnapshotsActionsTest-1282414551 None] Acquiring lock "cinder-quobyte-1402e9d0-9584-4c7a-89e0-72ef9d9f1308" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:16:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-abb3f01f-c041-4efe-be09-9dfc7a0611af tempest-SnapshotsActionsTest-1282414551 None] Lock "cinder-quobyte-1402e9d0-9584-4c7a-89e0-72ef9d9f1308" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:16:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-abb3f01f-c041-4efe-be09-9dfc7a0611af tempest-SnapshotsActionsTest-1282414551 None] Deleting offline snapshot 1402e9d0-9584-4c7a-89e0-72ef9d9f1308 of volume fa6b6e28-073d-4e76-8acb-82534904a72e {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:16:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-abb3f01f-c041-4efe-be09-9dfc7a0611af tempest-SnapshotsActionsTest-1282414551 None] snapshot_file for this snap is: volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1402e9d0-9584-4c7a-89e0-72ef9d9f1308 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:16:17 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b608f2f3-cb72-46c7-a753-d64a52714a02]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:16:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abb3f01f-c041-4efe-be09-9dfc7a0611af tempest-SnapshotsActionsTest-1282414551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1402e9d0-9584-4c7a-89e0-72ef9d9f1308 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:18 devstack sudo[102172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1402e9d0-9584-4c7a-89e0-72ef9d9f1308
Nov 05 15:16:18 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:18 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abb3f01f-c041-4efe-be09-9dfc7a0611af tempest-SnapshotsActionsTest-1282414551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1402e9d0-9584-4c7a-89e0-72ef9d9f1308" returned: 0 in 0.438s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-abb3f01f-c041-4efe-be09-9dfc7a0611af tempest-SnapshotsActionsTest-1282414551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa6b6e28-073d-4e76-8acb-82534904a72e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:16:18 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0be9cd8-2a0f-4c63-8bbb-f7fb11bdcfd8]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:16:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abb3f01f-c041-4efe-be09-9dfc7a0611af tempest-SnapshotsActionsTest-1282414551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:18 devstack sudo[102178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b
Nov 05 15:16:18 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:18 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abb3f01f-c041-4efe-be09-9dfc7a0611af tempest-SnapshotsActionsTest-1282414551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b" returned: 0 in 0.444s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-abb3f01f-c041-4efe-be09-9dfc7a0611af tempest-SnapshotsActionsTest-1282414551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa6b6e28-073d-4e76-8acb-82534904a72e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:16:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abb3f01f-c041-4efe-be09-9dfc7a0611af tempest-SnapshotsActionsTest-1282414551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1402e9d0-9584-4c7a-89e0-72ef9d9f1308 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:18 devstack sudo[102183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1402e9d0-9584-4c7a-89e0-72ef9d9f1308
Nov 05 15:16:18 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:19 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abb3f01f-c041-4efe-be09-9dfc7a0611af tempest-SnapshotsActionsTest-1282414551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1402e9d0-9584-4c7a-89e0-72ef9d9f1308" returned: 0 in 0.486s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abb3f01f-c041-4efe-be09-9dfc7a0611af tempest-SnapshotsActionsTest-1282414551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1402e9d0-9584-4c7a-89e0-72ef9d9f1308 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:19 devstack sudo[102190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1402e9d0-9584-4c7a-89e0-72ef9d9f1308
Nov 05 15:16:19 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:19 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abb3f01f-c041-4efe-be09-9dfc7a0611af tempest-SnapshotsActionsTest-1282414551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.1402e9d0-9584-4c7a-89e0-72ef9d9f1308" returned: 0 in 0.269s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-abb3f01f-c041-4efe-be09-9dfc7a0611af tempest-SnapshotsActionsTest-1282414551 None] Lock "cinder-quobyte-1402e9d0-9584-4c7a-89e0-72ef9d9f1308" released by "_delete_snapshot" :: held 1.790s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:16:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-abb3f01f-c041-4efe-be09-9dfc7a0611af tempest-SnapshotsActionsTest-1282414551 None] Lock "cinder-quobyte-fa6b6e28-073d-4e76-8acb-82534904a72e" released by "delete_snapshot" :: held 1.821s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:16:19 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-abb3f01f-c041-4efe-be09-9dfc7a0611af tempest-SnapshotsActionsTest-1282414551 None] Created reservations ['3b9c786c-5993-45d4-ba66-0229e81c5d17', '5bdddfa5-fd42-46ef-985a-01517245b0c4', '762dafee-b074-409d-838b-0ca64d2d00dc', 'ac0216f4-dc72-460d-b54e-854d51c029c9'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:16:19 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-abb3f01f-c041-4efe-be09-9dfc7a0611af tempest-SnapshotsActionsTest-1282414551 None] Delete snapshot completed successfully.
Nov 05 15:16:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-abb3f01f-c041-4efe-be09-9dfc7a0611af tempest-SnapshotsActionsTest-1282414551 None] Lock "cinder-1402e9d0-9584-4c7a-89e0-72ef9d9f1308-delete_snapshot" released by "delete_snapshot" :: held 1.991s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:16:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-abf84874-0c3c-496f-bb9e-2b36b8b3885d tempest-SnapshotsActionsTest-1456956290 None] Acquiring lock "cinder-4684906e-99d9-45ec-b0e7-d381a735506b-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:16:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-abf84874-0c3c-496f-bb9e-2b36b8b3885d tempest-SnapshotsActionsTest-1456956290 None] Lock "cinder-4684906e-99d9-45ec-b0e7-d381a735506b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:16:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-abf84874-0c3c-496f-bb9e-2b36b8b3885d tempest-SnapshotsActionsTest-1456956290 None] Acquiring lock "cinder-quobyte-fa6b6e28-073d-4e76-8acb-82534904a72e" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:16:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-abf84874-0c3c-496f-bb9e-2b36b8b3885d tempest-SnapshotsActionsTest-1456956290 None] Lock "cinder-quobyte-fa6b6e28-073d-4e76-8acb-82534904a72e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:16:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-abf84874-0c3c-496f-bb9e-2b36b8b3885d tempest-SnapshotsActionsTest-1456956290 None] Acquiring lock "cinder-quobyte-4684906e-99d9-45ec-b0e7-d381a735506b" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:16:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-abf84874-0c3c-496f-bb9e-2b36b8b3885d tempest-SnapshotsActionsTest-1456956290 None] Lock "cinder-quobyte-4684906e-99d9-45ec-b0e7-d381a735506b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:16:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-abf84874-0c3c-496f-bb9e-2b36b8b3885d tempest-SnapshotsActionsTest-1456956290 None] Deleting offline snapshot 4684906e-99d9-45ec-b0e7-d381a735506b of volume fa6b6e28-073d-4e76-8acb-82534904a72e {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:16:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-abf84874-0c3c-496f-bb9e-2b36b8b3885d tempest-SnapshotsActionsTest-1456956290 None] snapshot_file for this snap is: volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:16:20 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e67c47-d6dd-4e03-9ff7-c0619d81ee9e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:16:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abf84874-0c3c-496f-bb9e-2b36b8b3885d tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:20 devstack sudo[102197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b
Nov 05 15:16:20 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:21 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abf84874-0c3c-496f-bb9e-2b36b8b3885d tempest-SnapshotsActionsTest-1456956290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b" returned: 0 in 0.441s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-abf84874-0c3c-496f-bb9e-2b36b8b3885d tempest-SnapshotsActionsTest-1456956290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa6b6e28-073d-4e76-8acb-82534904a72e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:16:21 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f019c60b-9b6d-47ac-b257-0a091b876c4a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:16:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abf84874-0c3c-496f-bb9e-2b36b8b3885d tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:21 devstack sudo[102205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e
Nov 05 15:16:21 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:21 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abf84874-0c3c-496f-bb9e-2b36b8b3885d tempest-SnapshotsActionsTest-1456956290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e" returned: 0 in 0.498s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abf84874-0c3c-496f-bb9e-2b36b8b3885d tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:21 devstack sudo[102244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b
Nov 05 15:16:21 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:22 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abf84874-0c3c-496f-bb9e-2b36b8b3885d tempest-SnapshotsActionsTest-1456956290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b" returned: 0 in 0.446s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abf84874-0c3c-496f-bb9e-2b36b8b3885d tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:22 devstack sudo[102252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b
Nov 05 15:16:22 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:22 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abf84874-0c3c-496f-bb9e-2b36b8b3885d tempest-SnapshotsActionsTest-1456956290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e.4684906e-99d9-45ec-b0e7-d381a735506b" returned: 0 in 0.281s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-abf84874-0c3c-496f-bb9e-2b36b8b3885d tempest-SnapshotsActionsTest-1456956290 None] Lock "cinder-quobyte-4684906e-99d9-45ec-b0e7-d381a735506b" released by "_delete_snapshot" :: held 1.811s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:16:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-abf84874-0c3c-496f-bb9e-2b36b8b3885d tempest-SnapshotsActionsTest-1456956290 None] Lock "cinder-quobyte-fa6b6e28-073d-4e76-8acb-82534904a72e" released by "delete_snapshot" :: held 1.836s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:16:22 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-abf84874-0c3c-496f-bb9e-2b36b8b3885d tempest-SnapshotsActionsTest-1456956290 None] Created reservations ['15334e8f-06a9-4b9d-a90d-2479f0bdf84c', '36547dd3-eecb-45cf-98c3-55de9c297cd0', 'e0533016-5aa4-4392-9d07-a1899df53167', 'ffa8128b-2ab1-4483-8308-798c4d88befb'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:16:22 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-abf84874-0c3c-496f-bb9e-2b36b8b3885d tempest-SnapshotsActionsTest-1456956290 None] Delete snapshot completed successfully.
Nov 05 15:16:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-abf84874-0c3c-496f-bb9e-2b36b8b3885d tempest-SnapshotsActionsTest-1456956290 None] Lock "cinder-4684906e-99d9-45ec-b0e7-d381a735506b-delete_snapshot" released by "delete_snapshot" :: held 2.021s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:16:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b585a9bf-ff87-456c-8bfc-74828ccc921c tempest-SnapshotsActionsTest-1456956290 None] Acquiring lock "cinder-fa6b6e28-073d-4e76-8acb-82534904a72e-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:16:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b585a9bf-ff87-456c-8bfc-74828ccc921c tempest-SnapshotsActionsTest-1456956290 None] Lock "cinder-fa6b6e28-073d-4e76-8acb-82534904a72e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:16:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b585a9bf-ff87-456c-8bfc-74828ccc921c tempest-SnapshotsActionsTest-1456956290 None] Acquiring lock "cinder-quobyte-fa6b6e28-073d-4e76-8acb-82534904a72e" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:16:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b585a9bf-ff87-456c-8bfc-74828ccc921c tempest-SnapshotsActionsTest-1456956290 None] Lock "cinder-quobyte-fa6b6e28-073d-4e76-8acb-82534904a72e" acquired by "delete_volume" :: waited 0.032s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:16:23 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d678e4ae-144b-44a3-893d-bf4f1b50514a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:16:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b585a9bf-ff87-456c-8bfc-74828ccc921c tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:23 devstack sudo[102256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e
Nov 05 15:16:23 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:23 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b585a9bf-ff87-456c-8bfc-74828ccc921c tempest-SnapshotsActionsTest-1456956290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e" returned: 0 in 0.507s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b585a9bf-ff87-456c-8bfc-74828ccc921c tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:23 devstack sudo[102261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e
Nov 05 15:16:23 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:23 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b585a9bf-ff87-456c-8bfc-74828ccc921c tempest-SnapshotsActionsTest-1456956290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fa6b6e28-073d-4e76-8acb-82534904a72e" returned: 0 in 0.328s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b585a9bf-ff87-456c-8bfc-74828ccc921c tempest-SnapshotsActionsTest-1456956290 None] Lock "cinder-quobyte-fa6b6e28-073d-4e76-8acb-82534904a72e" released by "delete_volume" :: held 0.972s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:16:24 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b585a9bf-ff87-456c-8bfc-74828ccc921c tempest-SnapshotsActionsTest-1456956290 None] Created reservations ['48c192a3-3193-42c1-b6c6-f19d669f182d', 'b2fc3570-5c61-41af-93d3-a887861db84b', 'bc9b63c7-2b4f-49af-a235-33a74f05a149', '2c38e52a-2857-4cdb-9bfb-87b673e4acf4'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:16:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b585a9bf-ff87-456c-8bfc-74828ccc921c tempest-SnapshotsActionsTest-1456956290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:16:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b585a9bf-ff87-456c-8bfc-74828ccc921c tempest-SnapshotsActionsTest-1456956290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:16:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b585a9bf-ff87-456c-8bfc-74828ccc921c tempest-SnapshotsActionsTest-1456956290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:16:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b585a9bf-ff87-456c-8bfc-74828ccc921c tempest-SnapshotsActionsTest-1456956290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:16:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b585a9bf-ff87-456c-8bfc-74828ccc921c tempest-SnapshotsActionsTest-1456956290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:16:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b585a9bf-ff87-456c-8bfc-74828ccc921c tempest-SnapshotsActionsTest-1456956290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:24 devstack sudo[102265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:16:24 devstack sudo[102265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:24 devstack sudo[102265]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b585a9bf-ff87-456c-8bfc-74828ccc921c tempest-SnapshotsActionsTest-1456956290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.259s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:24 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-b585a9bf-ff87-456c-8bfc-74828ccc921c tempest-SnapshotsActionsTest-1456956290 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:16:24 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b585a9bf-ff87-456c-8bfc-74828ccc921c tempest-SnapshotsActionsTest-1456956290 None] Deleted volume successfully.
Nov 05 15:16:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b585a9bf-ff87-456c-8bfc-74828ccc921c tempest-SnapshotsActionsTest-1456956290 None] Lock "cinder-fa6b6e28-073d-4e76-8acb-82534904a72e-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:16:34 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=87,cinder:UPDATE=86,cinder:INSERT=22,cinder:DELETE=8 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:16:36 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=93,cinder:UPDATE=82,cinder:INSERT=21,cinder:DELETE=4 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:16:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:16:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:16:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:16:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:16:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:16:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:16:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:37 devstack sudo[102272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:16:37 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:37 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.400s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:16:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:16:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 15:16:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread info: [<_MainThread(MainThread, started 136317437956224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136317326340928)>, <Thread(Thread-3 (stat_writer), started daemon 136317326487936)>, <Thread(Rabbit-heartbeat, started daemon 136317321464000)>, <Thread(Thread-5 (_runner), started daemon 136317321550592)>, <Thread(Thread-7 (_runner), started daemon 136317321658496)>, <Thread(fd_logger, started daemon 136317319612992)>, <Thread(privsep_reader, started daemon 136317319622400)>, <Thread(tpool_thread_0, started daemon 136317310928576)>, <Thread(tpool_thread_1, started daemon 136317302535872)>, <Thread(tpool_thread_2, started daemon 136317294143168)>, <Thread(tpool_thread_3, started daemon 136317285750464)>, <Thread(tpool_thread_4, started daemon 136317277357760)>, <Thread(tpool_thread_5, started daemon 136317268965056)>, <Thread(tpool_thread_6, started daemon 136317260572352)>, <Thread(tpool_thread_7, started daemon 136317252179648)>, <Thread(tpool_thread_8, started daemon 136317243786944)>, <Thread(tpool_thread_9, started daemon 136317235394240)>, <Thread(tpool_thread_10, started daemon 136317227001536)>, <Thread(tpool_thread_11, started daemon 136317218608832)>, <Thread(tpool_thread_12, started daemon 136317210216128)>, <Thread(tpool_thread_13, started daemon 136317201807040)>, <Thread(tpool_thread_14, started daemon 136317193397952)>, <Thread(tpool_thread_15, started daemon 136317184988864)>, <Thread(tpool_thread_16, started daemon 136317176579776)>, <Thread(tpool_thread_17, started daemon 136317168170688)>, <Thread(tpool_thread_18, started daemon 136317159761600)>, <Thread(tpool_thread_19, started daemon 136317151352512)>] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 15:16:43 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:16:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Flow 'volume_create_manager' (8ddddc67-f5ab-4ba5-a788-1a98889e7196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:16:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f1bfa7-7595-4e49-9247-5ce994ac3f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:16:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f1bfa7-7595-4e49-9247-5ce994ac3f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-359467738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b444cb8-a638-4769-bbb6-fae809461cee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92077f85502549feb88daacb991273e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:16:43Z,use_quota=True,user_id='5d4109cbd03d4aa9959359bd70cd1097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:16:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1ac98a-c0fb-4c14-9729-563f11ed29b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:16:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1ac98a-c0fb-4c14-9729-563f11ed29b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:16:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c6d490-fd61-4a12-a46a-5e5b9fcc4dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:16:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c6d490-fd61-4a12-a46a-5e5b9fcc4dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b444cb8-a638-4769-bbb6-fae809461cee', 'volume_name': 'volume-0b444cb8-a638-4769-bbb6-fae809461cee', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:16:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a257df6a-547c-4f47-b10d-8f39ce4b8f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:16:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a257df6a-547c-4f47-b10d-8f39ce4b8f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:16:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c44239f-67b3-4ef7-b628-0ad3131e6132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:16:43 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Volume 0b444cb8-a638-4769-bbb6-fae809461cee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b444cb8-a638-4769-bbb6-fae809461cee', 'volume_size': 1}
Nov 05 15:16:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:16:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:16:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-359467738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b444cb8-a638-4769-bbb6-fae809461cee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92077f85502549feb88daacb991273e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:16:43Z,use_quota=True,user_id='5d4109cbd03d4aa9959359bd70cd1097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:16:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Creating volume 0b444cb8-a638-4769-bbb6-fae809461cee {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:16:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:16:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:16:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:16:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:16:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:16:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:16:43 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:16:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:43 devstack sudo[102276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee 1073741824
Nov 05 15:16:43 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:43 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee 1073741824" returned: 0 in 0.585s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:43 devstack sudo[102282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee
Nov 05 15:16:43 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:44 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee" returned: 0 in 0.315s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:16:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:16:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c44239f-67b3-4ef7-b628-0ad3131e6132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b444cb8-a638-4769-bbb6-fae809461cee', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:16:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e655bc8b-c230-4a50-9270-84f6f41a8fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:16:44 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Volume volume-0b444cb8-a638-4769-bbb6-fae809461cee (0b444cb8-a638-4769-bbb6-fae809461cee): created successfully
Nov 05 15:16:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e655bc8b-c230-4a50-9270-84f6f41a8fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:16:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Flow 'volume_create_manager' (8ddddc67-f5ab-4ba5-a788-1a98889e7196) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:16:44 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7671aab3-2d91-4dba-86a4-84040a029f9b tempest-TestImageHashVerification-1375483499 None] Created volume successfully.
Nov 05 15:16:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6eefdb9a-1db2-4d20-8e05-4da97ef40094 tempest-TestImageHashVerification-1375483499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:16:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6eefdb9a-1db2-4d20-8e05-4da97ef40094 tempest-TestImageHashVerification-1375483499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:16:46 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bd8666-0fa6-4c05-b911-2ecb63741a69]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:16:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6eefdb9a-1db2-4d20-8e05-4da97ef40094 tempest-TestImageHashVerification-1375483499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:46 devstack sudo[102285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee
Nov 05 15:16:46 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:46 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6eefdb9a-1db2-4d20-8e05-4da97ef40094 tempest-TestImageHashVerification-1375483499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee" returned: 0 in 0.523s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:46 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9859a29-ee07-4333-857a-d06a20247825]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:16:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6eefdb9a-1db2-4d20-8e05-4da97ef40094 tempest-TestImageHashVerification-1375483499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:47 devstack sudo[102297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee
Nov 05 15:16:47 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:47 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6eefdb9a-1db2-4d20-8e05-4da97ef40094 tempest-TestImageHashVerification-1375483499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee" returned: 0 in 0.402s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6eefdb9a-1db2-4d20-8e05-4da97ef40094 tempest-TestImageHashVerification-1375483499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee /opt/stack/data/cinder/conversion/0b444cb8-a638-4769-bbb6-fae809461cee.temp_image.cc1e82ea-11db-4c0e-8ae3-6386724cee44vn2f29w8.img {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:47 devstack sudo[102302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee /opt/stack/data/cinder/conversion/0b444cb8-a638-4769-bbb6-fae809461cee.temp_image.cc1e82ea-11db-4c0e-8ae3-6386724cee44vn2f29w8.img
Nov 05 15:16:47 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:54 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:16:55 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6eefdb9a-1db2-4d20-8e05-4da97ef40094 tempest-TestImageHashVerification-1375483499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee /opt/stack/data/cinder/conversion/0b444cb8-a638-4769-bbb6-fae809461cee.temp_image.cc1e82ea-11db-4c0e-8ae3-6386724cee44vn2f29w8.img" returned: 0 in 8.178s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:55 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[86621394-5668-4607-9b3b-14c1f0cf7b83]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:16:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6eefdb9a-1db2-4d20-8e05-4da97ef40094 tempest-TestImageHashVerification-1375483499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:16:55 devstack sudo[102317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee
Nov 05 15:16:55 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:16:56 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root
Nov 05 15:16:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6eefdb9a-1db2-4d20-8e05-4da97ef40094 tempest-TestImageHashVerification-1375483499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee" returned: 0 in 0.584s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:16:56 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-6eefdb9a-1db2-4d20-8e05-4da97ef40094 tempest-TestImageHashVerification-1375483499 None] Image conversion details: src /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee, size 1024.00 MB, duration 8.18 sec, destination /opt/stack/data/cinder/conversion/0b444cb8-a638-4769-bbb6-fae809461cee.temp_image.cc1e82ea-11db-4c0e-8ae3-6386724cee44vn2f29w8.img {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:16:56 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-6eefdb9a-1db2-4d20-8e05-4da97ef40094 tempest-TestImageHashVerification-1375483499 None] Converted 1024.00 MB image at 125.20 MB/s
Nov 05 15:16:56 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-6eefdb9a-1db2-4d20-8e05-4da97ef40094 tempest-TestImageHashVerification-1375483499 None] cc1e82ea-11db-4c0e-8ae3-6386724cee44 was raw, no need to convert to raw {{(pid=87150) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 05 15:16:56 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:16:56 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:16:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Flow 'volume_create_manager' (dd2235e5-2eeb-4815-b436-d0732db51257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:16:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5f619b-2c5d-4798-9eda-306bc4307152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:16:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5f619b-2c5d-4798-9eda-306bc4307152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-527210886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2779b285-244e-4949-a128-36fe34f21b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f6c3f2613f408ba83d955416ea33de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:16:57Z,use_quota=True,user_id='cdaf227c1b594522a4f6f48156289007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ec74e9f-6dc4-4396-9bcb-837a0de9283d),volume_type_id=3ec74e9f-6dc4-4396-9bcb-837a0de9283d)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:16:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8230e370-3281-4952-96c7-c24c929bab20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:16:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8230e370-3281-4952-96c7-c24c929bab20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:16:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d894e5-8cd7-4568-a41a-4d318d3974db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:16:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d894e5-8cd7-4568-a41a-4d318d3974db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2779b285-244e-4949-a128-36fe34f21b35', 'volume_name': 'volume-2779b285-244e-4949-a128-36fe34f21b35', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:16:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6760dc4-6a51-4987-9aa7-6b9c9e96f397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:16:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6760dc4-6a51-4987-9aa7-6b9c9e96f397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:16:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b7d232-ab80-4216-8c95-0414feebc451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:16:56 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Volume 2779b285-244e-4949-a128-36fe34f21b35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2779b285-244e-4949-a128-36fe34f21b35', 'volume_size': 1}
Nov 05 15:16:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:16:58 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:16:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Flow 'volume_create_manager' (ac54b75c-763d-484a-b54c-233fab11857b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:16:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fbd848f-cc7f-41ab-8fe4-2689d9eeb543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:16:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fbd848f-cc7f-41ab-8fe4-2689d9eeb543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-381518795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1547b30c-4653-4fec-9343-e3cfa76f9a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b23e86a74354b86996ef1286a25261e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:16:58Z,use_quota=True,user_id='aef669e54fde42d2a7fdf260f6fb5be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:16:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a1c8e38-3f1d-48d2-94d6-5cddd8b98dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:16:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a1c8e38-3f1d-48d2-94d6-5cddd8b98dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:16:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (426e009d-830f-4ce1-94bd-39a37de31583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:16:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (426e009d-830f-4ce1-94bd-39a37de31583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1547b30c-4653-4fec-9343-e3cfa76f9a65', 'volume_name': 'volume-1547b30c-4653-4fec-9343-e3cfa76f9a65', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:16:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7baf2b3c-6408-4927-b948-b198316da066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:16:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7baf2b3c-6408-4927-b948-b198316da066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:16:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af61e0c-ad6a-4fb2-a98f-ed2c2dc8d850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:16:58 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Volume 1547b30c-4653-4fec-9343-e3cfa76f9a65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1547b30c-4653-4fec-9343-e3cfa76f9a65', 'volume_size': 1}
Nov 05 15:16:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:16:58 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:16:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Flow 'volume_create_manager' (9299a963-57a5-422a-bc77-887084bc34c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:16:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3b2ee2-5905-48f1-9f9f-b987642356ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:16:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3b2ee2-5905-48f1-9f9f-b987642356ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-170266155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe83d59-0ddd-4ca5-a935-424cc000ebf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b23e86a74354b86996ef1286a25261e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:16:59Z,use_quota=True,user_id='aef669e54fde42d2a7fdf260f6fb5be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:16:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e7621b-c328-40ce-bd03-f8e5a5aa4a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:16:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e7621b-c328-40ce-bd03-f8e5a5aa4a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:16:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecbf25a4-94b0-4972-a639-be3fc5bc3381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:16:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecbf25a4-94b0-4972-a639-be3fc5bc3381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afe83d59-0ddd-4ca5-a935-424cc000ebf9', 'volume_name': 'volume-afe83d59-0ddd-4ca5-a935-424cc000ebf9', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:16:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620812c3-8745-414c-9ded-5a586274dc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:16:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620812c3-8745-414c-9ded-5a586274dc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:16:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748f1c58-711a-43bd-b54d-138224234d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:16:58 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Volume afe83d59-0ddd-4ca5-a935-424cc000ebf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afe83d59-0ddd-4ca5-a935-424cc000ebf9', 'volume_size': 1}
Nov 05 15:16:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:17:08 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:17:08 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:17:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6eefdb9a-1db2-4d20-8e05-4da97ef40094 tempest-TestImageHashVerification-1375483499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.462s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:17:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6eefdb9a-1db2-4d20-8e05-4da97ef40094 tempest-TestImageHashVerification-1375483499 None] Uploaded volume to glance image-id: cc1e82ea-11db-4c0e-8ae3-6386724cee44. {{(pid=87150) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 05 15:17:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.945s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:17:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-527210886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2779b285-244e-4949-a128-36fe34f21b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f6c3f2613f408ba83d955416ea33de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:16:57Z,use_quota=True,user_id='cdaf227c1b594522a4f6f48156289007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ec74e9f-6dc4-4396-9bcb-837a0de9283d),volume_type_id=3ec74e9f-6dc4-4396-9bcb-837a0de9283d)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:17:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Creating volume 2779b285-244e-4949-a128-36fe34f21b35 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:17:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:17:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:17:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:17:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:17:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:17:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:17:17 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:17:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2779b285-244e-4949-a128-36fe34f21b35 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:17 devstack sudo[102423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2779b285-244e-4949-a128-36fe34f21b35 1073741824
Nov 05 15:17:17 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:17 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6eefdb9a-1db2-4d20-8e05-4da97ef40094 tempest-TestImageHashVerification-1375483499 None] Copy volume to image completed successfully.
Nov 05 15:17:18 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2779b285-244e-4949-a128-36fe34f21b35 1073741824" returned: 0 in 0.482s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2779b285-244e-4949-a128-36fe34f21b35 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:18 devstack sudo[102429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2779b285-244e-4949-a128-36fe34f21b35
Nov 05 15:17:18 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-339e3fd2-c42f-4af4-b902-b26852a2d078 tempest-TestImageHashVerification-1375483499 None] Acquiring lock "cinder-0b444cb8-a638-4769-bbb6-fae809461cee-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-339e3fd2-c42f-4af4-b902-b26852a2d078 tempest-TestImageHashVerification-1375483499 None] Lock "cinder-0b444cb8-a638-4769-bbb6-fae809461cee-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:17:18 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2779b285-244e-4949-a128-36fe34f21b35" returned: 0 in 0.314s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.419s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-381518795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1547b30c-4653-4fec-9343-e3cfa76f9a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b23e86a74354b86996ef1286a25261e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:16:58Z,use_quota=True,user_id='aef669e54fde42d2a7fdf260f6fb5be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Creating volume 1547b30c-4653-4fec-9343-e3cfa76f9a65 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:17:18 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1547b30c-4653-4fec-9343-e3cfa76f9a65 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b7d232-ab80-4216-8c95-0414feebc451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2779b285-244e-4949-a128-36fe34f21b35', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:17:18 devstack sudo[102432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1547b30c-4653-4fec-9343-e3cfa76f9a65 1073741824
Nov 05 15:17:18 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4da3dbc-30ab-4735-9e9d-22d46a4a2147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:17:18 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Volume volume-2779b285-244e-4949-a128-36fe34f21b35 (2779b285-244e-4949-a128-36fe34f21b35): created successfully
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4da3dbc-30ab-4735-9e9d-22d46a4a2147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Flow 'volume_create_manager' (dd2235e5-2eeb-4815-b436-d0732db51257) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:17:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a288112b-d4b3-4989-9a20-f6318057d3b0 tempest-VolumeTypesAccessTest-720659335 None] Created volume successfully.
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-339e3fd2-c42f-4af4-b902-b26852a2d078 tempest-TestImageHashVerification-1375483499 None] Acquiring lock "cinder-quobyte-0b444cb8-a638-4769-bbb6-fae809461cee" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-339e3fd2-c42f-4af4-b902-b26852a2d078 tempest-TestImageHashVerification-1375483499 None] Lock "cinder-quobyte-0b444cb8-a638-4769-bbb6-fae809461cee" acquired by "delete_volume" :: waited 0.028s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a79b5b8-3677-4116-8ebb-01f1fdb49095]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:17:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-339e3fd2-c42f-4af4-b902-b26852a2d078 tempest-TestImageHashVerification-1375483499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:19 devstack sudo[102434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee
Nov 05 15:17:19 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:19 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1547b30c-4653-4fec-9343-e3cfa76f9a65 1073741824" returned: 0 in 0.577s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:19 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-339e3fd2-c42f-4af4-b902-b26852a2d078 tempest-TestImageHashVerification-1375483499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee" returned: 0 in 0.407s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-339e3fd2-c42f-4af4-b902-b26852a2d078 tempest-TestImageHashVerification-1375483499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:19 devstack sudo[102445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee
Nov 05 15:17:19 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1547b30c-4653-4fec-9343-e3cfa76f9a65 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:19 devstack sudo[102447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1547b30c-4653-4fec-9343-e3cfa76f9a65
Nov 05 15:17:19 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0a341f51-20a2-4b0c-abef-c6dde7103bbb tempest-VolumeTypesAccessTest-720659335 None] Acquiring lock "cinder-2779b285-244e-4949-a128-36fe34f21b35-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0a341f51-20a2-4b0c-abef-c6dde7103bbb tempest-VolumeTypesAccessTest-720659335 None] Lock "cinder-2779b285-244e-4949-a128-36fe34f21b35-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0a341f51-20a2-4b0c-abef-c6dde7103bbb tempest-VolumeTypesAccessTest-720659335 None] Acquiring lock "cinder-quobyte-2779b285-244e-4949-a128-36fe34f21b35" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0a341f51-20a2-4b0c-abef-c6dde7103bbb tempest-VolumeTypesAccessTest-720659335 None] Lock "cinder-quobyte-2779b285-244e-4949-a128-36fe34f21b35" acquired by "delete_volume" :: waited 0.042s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:17:19 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-339e3fd2-c42f-4af4-b902-b26852a2d078 tempest-TestImageHashVerification-1375483499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0b444cb8-a638-4769-bbb6-fae809461cee" returned: 0 in 0.413s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:19 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-339e3fd2-c42f-4af4-b902-b26852a2d078 tempest-TestImageHashVerification-1375483499 None] Lock "cinder-quobyte-0b444cb8-a638-4769-bbb6-fae809461cee" released by "delete_volume" :: held 0.865s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ef282b-8ddb-4191-822a-4252497f0fd5]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0a341f51-20a2-4b0c-abef-c6dde7103bbb tempest-VolumeTypesAccessTest-720659335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2779b285-244e-4949-a128-36fe34f21b35 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1547b30c-4653-4fec-9343-e3cfa76f9a65" returned: 0 in 0.394s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-170266155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe83d59-0ddd-4ca5-a935-424cc000ebf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b23e86a74354b86996ef1286a25261e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:16:59Z,use_quota=True,user_id='aef669e54fde42d2a7fdf260f6fb5be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Creating volume afe83d59-0ddd-4ca5-a935-424cc000ebf9 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:17:19 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-afe83d59-0ddd-4ca5-a935-424cc000ebf9 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af61e0c-ad6a-4fb2-a98f-ed2c2dc8d850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1547b30c-4653-4fec-9343-e3cfa76f9a65', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:17:19 devstack sudo[102452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-afe83d59-0ddd-4ca5-a935-424cc000ebf9 1073741824
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67825c1-9742-4fb8-98fb-3c8d7f556675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:17:19 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:19 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Volume volume-1547b30c-4653-4fec-9343-e3cfa76f9a65 (1547b30c-4653-4fec-9343-e3cfa76f9a65): created successfully
Nov 05 15:17:19 devstack sudo[102451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2779b285-244e-4949-a128-36fe34f21b35
Nov 05 15:17:19 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67825c1-9742-4fb8-98fb-3c8d7f556675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Flow 'volume_create_manager' (ac54b75c-763d-484a-b54c-233fab11857b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:17:19 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-48da298e-96ee-48d8-90ae-a68a09a0e17f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Created volume successfully.
Nov 05 15:17:19 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-339e3fd2-c42f-4af4-b902-b26852a2d078 tempest-TestImageHashVerification-1375483499 None] Created reservations ['ee906f98-4ea1-4db6-8d64-23ce85bde6ac', '6d6e0742-340a-4d85-b0f1-c4d383afab22', '5006bb52-ea26-4192-a3c6-13b4df14cbc5', 'a892c9d8-28e9-46fb-89bf-43adee7301a5'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-339e3fd2-c42f-4af4-b902-b26852a2d078 tempest-TestImageHashVerification-1375483499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-339e3fd2-c42f-4af4-b902-b26852a2d078 tempest-TestImageHashVerification-1375483499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-339e3fd2-c42f-4af4-b902-b26852a2d078 tempest-TestImageHashVerification-1375483499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-339e3fd2-c42f-4af4-b902-b26852a2d078 tempest-TestImageHashVerification-1375483499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-339e3fd2-c42f-4af4-b902-b26852a2d078 tempest-TestImageHashVerification-1375483499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-339e3fd2-c42f-4af4-b902-b26852a2d078 tempest-TestImageHashVerification-1375483499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:20 devstack sudo[102469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:17:20 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:20 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0a341f51-20a2-4b0c-abef-c6dde7103bbb tempest-VolumeTypesAccessTest-720659335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2779b285-244e-4949-a128-36fe34f21b35" returned: 0 in 0.513s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0a341f51-20a2-4b0c-abef-c6dde7103bbb tempest-VolumeTypesAccessTest-720659335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2779b285-244e-4949-a128-36fe34f21b35 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:20 devstack sudo[102482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2779b285-244e-4949-a128-36fe34f21b35
Nov 05 15:17:20 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:20 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-339e3fd2-c42f-4af4-b902-b26852a2d078 tempest-TestImageHashVerification-1375483499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.292s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-339e3fd2-c42f-4af4-b902-b26852a2d078 tempest-TestImageHashVerification-1375483499 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:17:20 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-339e3fd2-c42f-4af4-b902-b26852a2d078 tempest-TestImageHashVerification-1375483499 None] Deleted volume successfully.
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-339e3fd2-c42f-4af4-b902-b26852a2d078 tempest-TestImageHashVerification-1375483499 None] Lock "cinder-0b444cb8-a638-4769-bbb6-fae809461cee-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:17:20 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-afe83d59-0ddd-4ca5-a935-424cc000ebf9 1073741824" returned: 0 in 0.653s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-afe83d59-0ddd-4ca5-a935-424cc000ebf9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:20 devstack sudo[102485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-afe83d59-0ddd-4ca5-a935-424cc000ebf9
Nov 05 15:17:20 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:20 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0a341f51-20a2-4b0c-abef-c6dde7103bbb tempest-VolumeTypesAccessTest-720659335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2779b285-244e-4949-a128-36fe34f21b35" returned: 0 in 0.303s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0a341f51-20a2-4b0c-abef-c6dde7103bbb tempest-VolumeTypesAccessTest-720659335 None] Lock "cinder-quobyte-2779b285-244e-4949-a128-36fe34f21b35" released by "delete_volume" :: held 0.873s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:17:20 devstack cinder-volume[87150]: WARNING cinder.quota [None req-0a341f51-20a2-4b0c-abef-c6dde7103bbb tempest-VolumeTypesAccessTest-720659335 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1688726791 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1688726791, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:17:20 devstack cinder-volume[87150]: WARNING cinder.quota [None req-0a341f51-20a2-4b0c-abef-c6dde7103bbb tempest-VolumeTypesAccessTest-720659335 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1688726791 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1688726791, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-0a341f51-20a2-4b0c-abef-c6dde7103bbb tempest-VolumeTypesAccessTest-720659335 None] Created reservations ['41100178-54b4-487b-bcd9-67c0e4f882a4', '2360b00f-9093-4d17-931a-e4631e6906c7', 'cbc5fd6e-1166-416b-b3fb-911e4f29de32', 'cd47a9b3-294f-473f-87d5-92bd6e2770cb'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0a341f51-20a2-4b0c-abef-c6dde7103bbb tempest-VolumeTypesAccessTest-720659335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0a341f51-20a2-4b0c-abef-c6dde7103bbb tempest-VolumeTypesAccessTest-720659335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0a341f51-20a2-4b0c-abef-c6dde7103bbb tempest-VolumeTypesAccessTest-720659335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0a341f51-20a2-4b0c-abef-c6dde7103bbb tempest-VolumeTypesAccessTest-720659335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0a341f51-20a2-4b0c-abef-c6dde7103bbb tempest-VolumeTypesAccessTest-720659335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0a341f51-20a2-4b0c-abef-c6dde7103bbb tempest-VolumeTypesAccessTest-720659335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:20 devstack sudo[102489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:17:20 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:20 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-afe83d59-0ddd-4ca5-a935-424cc000ebf9" returned: 0 in 0.276s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748f1c58-711a-43bd-b54d-138224234d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afe83d59-0ddd-4ca5-a935-424cc000ebf9', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c443cdd7-bcf8-4643-a246-fe4460a8a15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:17:20 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Volume volume-afe83d59-0ddd-4ca5-a935-424cc000ebf9 (afe83d59-0ddd-4ca5-a935-424cc000ebf9): created successfully
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c443cdd7-bcf8-4643-a246-fe4460a8a15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:17:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Flow 'volume_create_manager' (9299a963-57a5-422a-bc77-887084bc34c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:17:20 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-714baad4-3da1-4a8f-bafa-c396afacc212 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Created volume successfully.
Nov 05 15:17:21 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0a341f51-20a2-4b0c-abef-c6dde7103bbb tempest-VolumeTypesAccessTest-720659335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.313s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:21 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-0a341f51-20a2-4b0c-abef-c6dde7103bbb tempest-VolumeTypesAccessTest-720659335 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:17:21 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0a341f51-20a2-4b0c-abef-c6dde7103bbb tempest-VolumeTypesAccessTest-720659335 None] Deleted volume successfully.
Nov 05 15:17:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0a341f51-20a2-4b0c-abef-c6dde7103bbb tempest-VolumeTypesAccessTest-720659335 None] Lock "cinder-2779b285-244e-4949-a128-36fe34f21b35-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:17:28 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:17:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Flow 'volume_create_manager' (b7bbdbee-da4d-4883-9751-f0b4b0e51077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:17:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb17b6a-e1ff-4054-87a9-e64d891c4d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:17:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb17b6a-e1ff-4054-87a9-e64d891c4d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1830275114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8351815a-173d-476b-bb7b-288e15a9adf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='817807203aab49769d449d3a7530d4fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:29Z,use_quota=True,user_id='4f432d5903644121a06425288a2ee1c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:17:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63af5d06-c702-4176-b2c6-1352d9b68525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:17:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63af5d06-c702-4176-b2c6-1352d9b68525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:17:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1ecfe3d-5418-4ce0-a632-f1988117df9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:17:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1ecfe3d-5418-4ce0-a632-f1988117df9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8351815a-173d-476b-bb7b-288e15a9adf0', 'volume_name': 'volume-8351815a-173d-476b-bb7b-288e15a9adf0', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:17:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b380d6-222d-402f-8845-392b30ca7711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:17:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b380d6-222d-402f-8845-392b30ca7711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:17:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6163ebf0-c46f-4237-abf0-8ce05e9be0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:17:28 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Volume 8351815a-173d-476b-bb7b-288e15a9adf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8351815a-173d-476b-bb7b-288e15a9adf0', 'volume_size': 1}
Nov 05 15:17:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:17:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:17:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1830275114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8351815a-173d-476b-bb7b-288e15a9adf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='817807203aab49769d449d3a7530d4fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:29Z,use_quota=True,user_id='4f432d5903644121a06425288a2ee1c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:17:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Creating volume 8351815a-173d-476b-bb7b-288e15a9adf0 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:17:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:17:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:17:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:17:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:17:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:17:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:17:28 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:17:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8351815a-173d-476b-bb7b-288e15a9adf0 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:28 devstack sudo[102538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8351815a-173d-476b-bb7b-288e15a9adf0 1073741824
Nov 05 15:17:28 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:29 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8351815a-173d-476b-bb7b-288e15a9adf0 1073741824" returned: 0 in 0.431s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8351815a-173d-476b-bb7b-288e15a9adf0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:29 devstack sudo[102545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8351815a-173d-476b-bb7b-288e15a9adf0
Nov 05 15:17:29 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:29 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8351815a-173d-476b-bb7b-288e15a9adf0" returned: 0 in 0.301s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:17:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:17:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6163ebf0-c46f-4237-abf0-8ce05e9be0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8351815a-173d-476b-bb7b-288e15a9adf0', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:17:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (328427b6-d96c-4f17-9990-a9a0af0fbd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:17:29 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Volume volume-8351815a-173d-476b-bb7b-288e15a9adf0 (8351815a-173d-476b-bb7b-288e15a9adf0): created successfully
Nov 05 15:17:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (328427b6-d96c-4f17-9990-a9a0af0fbd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:17:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Flow 'volume_create_manager' (b7bbdbee-da4d-4883-9751-f0b4b0e51077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:17:29 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a104d93c-44b9-4c93-a191-cc41c9262e47 tempest-AbsoluteLimitsTests-532531882 None] Created volume successfully.
Nov 05 15:17:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7b8ad246-0058-44e2-9192-a5826f39e88a tempest-AbsoluteLimitsTests-532531882 None] Acquiring lock "cinder-8351815a-173d-476b-bb7b-288e15a9adf0-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:17:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7b8ad246-0058-44e2-9192-a5826f39e88a tempest-AbsoluteLimitsTests-532531882 None] Lock "cinder-8351815a-173d-476b-bb7b-288e15a9adf0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:17:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7b8ad246-0058-44e2-9192-a5826f39e88a tempest-AbsoluteLimitsTests-532531882 None] Acquiring lock "cinder-quobyte-8351815a-173d-476b-bb7b-288e15a9adf0" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:17:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-df07e300-22b6-4fbb-aaa7-8d0689a0082a req-482c3412-c353-45de-b3eb-212f2e97ca8f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:17:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-df07e300-22b6-4fbb-aaa7-8d0689a0082a req-482c3412-c353-45de-b3eb-212f2e97ca8f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:17:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7b8ad246-0058-44e2-9192-a5826f39e88a tempest-AbsoluteLimitsTests-532531882 None] Lock "cinder-quobyte-8351815a-173d-476b-bb7b-288e15a9adf0" acquired by "delete_volume" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:17:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-df07e300-22b6-4fbb-aaa7-8d0689a0082a req-482c3412-c353-45de-b3eb-212f2e97ca8f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:17:31 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb6f8c6-0aba-4b39-8767-c118dd8c4404]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:17:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7b8ad246-0058-44e2-9192-a5826f39e88a tempest-AbsoluteLimitsTests-532531882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8351815a-173d-476b-bb7b-288e15a9adf0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-df07e300-22b6-4fbb-aaa7-8d0689a0082a req-482c3412-c353-45de-b3eb-212f2e97ca8f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628', 'name': 'volume-1547b30c-4653-4fec-9343-e3cfa76f9a65', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '030be3e9-d446-427c-9218-af39c746de6a', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 15:17:31 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-df07e300-22b6-4fbb-aaa7-8d0689a0082a req-482c3412-c353-45de-b3eb-212f2e97ca8f tempest-TestServerVolumeAttachmentScenario-1337950484 None] attachment_update completed successfully.
Nov 05 15:17:31 devstack sudo[102561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8351815a-173d-476b-bb7b-288e15a9adf0
Nov 05 15:17:31 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:31 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7b8ad246-0058-44e2-9192-a5826f39e88a tempest-AbsoluteLimitsTests-532531882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8351815a-173d-476b-bb7b-288e15a9adf0" returned: 0 in 0.458s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7b8ad246-0058-44e2-9192-a5826f39e88a tempest-AbsoluteLimitsTests-532531882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8351815a-173d-476b-bb7b-288e15a9adf0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:31 devstack sudo[102667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8351815a-173d-476b-bb7b-288e15a9adf0
Nov 05 15:17:31 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:32 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7b8ad246-0058-44e2-9192-a5826f39e88a tempest-AbsoluteLimitsTests-532531882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8351815a-173d-476b-bb7b-288e15a9adf0" returned: 0 in 0.322s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7b8ad246-0058-44e2-9192-a5826f39e88a tempest-AbsoluteLimitsTests-532531882 None] Lock "cinder-quobyte-8351815a-173d-476b-bb7b-288e15a9adf0" released by "delete_volume" :: held 0.844s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:17:32 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-7b8ad246-0058-44e2-9192-a5826f39e88a tempest-AbsoluteLimitsTests-532531882 None] Created reservations ['faa004e7-e6c3-40a9-b5db-e14f6758dc42', '18fb932c-2d4a-4551-afaf-56b06f9df776', '503041b1-e27a-4425-89cf-861b3affd83a', '28f6f395-ef33-4177-953f-d49af48ae476'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:17:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7b8ad246-0058-44e2-9192-a5826f39e88a tempest-AbsoluteLimitsTests-532531882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:17:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7b8ad246-0058-44e2-9192-a5826f39e88a tempest-AbsoluteLimitsTests-532531882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:17:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7b8ad246-0058-44e2-9192-a5826f39e88a tempest-AbsoluteLimitsTests-532531882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:17:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7b8ad246-0058-44e2-9192-a5826f39e88a tempest-AbsoluteLimitsTests-532531882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:17:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7b8ad246-0058-44e2-9192-a5826f39e88a tempest-AbsoluteLimitsTests-532531882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:17:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7b8ad246-0058-44e2-9192-a5826f39e88a tempest-AbsoluteLimitsTests-532531882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:32 devstack sudo[102987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:17:32 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:32 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7b8ad246-0058-44e2-9192-a5826f39e88a tempest-AbsoluteLimitsTests-532531882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.347s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:32 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-7b8ad246-0058-44e2-9192-a5826f39e88a tempest-AbsoluteLimitsTests-532531882 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:17:32 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7b8ad246-0058-44e2-9192-a5826f39e88a tempest-AbsoluteLimitsTests-532531882 None] Deleted volume successfully.
Nov 05 15:17:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7b8ad246-0058-44e2-9192-a5826f39e88a tempest-AbsoluteLimitsTests-532531882 None] Lock "cinder-8351815a-173d-476b-bb7b-288e15a9adf0-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:17:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-fe0b4622-2522-4fe3-afec-d555750cac51 req-27df0e1c-e672-40d3-9930-0434eef74844 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:17:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-fe0b4622-2522-4fe3-afec-d555750cac51 req-27df0e1c-e672-40d3-9930-0434eef74844 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:17:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-fe0b4622-2522-4fe3-afec-d555750cac51 req-27df0e1c-e672-40d3-9930-0434eef74844 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:17:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-fe0b4622-2522-4fe3-afec-d555750cac51 req-27df0e1c-e672-40d3-9930-0434eef74844 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628', 'name': 'volume-afe83d59-0ddd-4ca5-a935-424cc000ebf9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b537b4f-48fb-4271-9ed6-75ee71bda0bb', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 15:17:37 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-fe0b4622-2522-4fe3-afec-d555750cac51 req-27df0e1c-e672-40d3-9930-0434eef74844 tempest-TestServerVolumeAttachmentScenario-1337950484 None] attachment_update completed successfully.
Nov 05 15:17:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:17:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:17:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:17:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:17:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:17:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:17:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:37 devstack sudo[103010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:17:37 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:37 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.317s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:17:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:17:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 15:17:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread info: [<_MainThread(MainThread, started 136317437956224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136317326340928)>, <Thread(Thread-3 (stat_writer), started daemon 136317326487936)>, <Thread(Rabbit-heartbeat, started daemon 136317321464000)>, <Thread(Thread-5 (_runner), started daemon 136317321550592)>, <Thread(Thread-7 (_runner), started daemon 136317321658496)>, <Thread(fd_logger, started daemon 136317319612992)>, <Thread(privsep_reader, started daemon 136317319622400)>, <Thread(tpool_thread_0, started daemon 136317310928576)>, <Thread(tpool_thread_1, started daemon 136317302535872)>, <Thread(tpool_thread_2, started daemon 136317294143168)>, <Thread(tpool_thread_3, started daemon 136317285750464)>, <Thread(tpool_thread_4, started daemon 136317277357760)>, <Thread(tpool_thread_5, started daemon 136317268965056)>, <Thread(tpool_thread_6, started daemon 136317260572352)>, <Thread(tpool_thread_7, started daemon 136317252179648)>, <Thread(tpool_thread_8, started daemon 136317243786944)>, <Thread(tpool_thread_9, started daemon 136317235394240)>, <Thread(tpool_thread_10, started daemon 136317227001536)>, <Thread(tpool_thread_11, started daemon 136317218608832)>, <Thread(tpool_thread_12, started daemon 136317210216128)>, <Thread(tpool_thread_13, started daemon 136317201807040)>, <Thread(tpool_thread_14, started daemon 136317193397952)>, <Thread(tpool_thread_15, started daemon 136317184988864)>, <Thread(tpool_thread_16, started daemon 136317176579776)>, <Thread(tpool_thread_17, started daemon 136317168170688)>, <Thread(tpool_thread_18, started daemon 136317159761600)>, <Thread(tpool_thread_19, started daemon 136317151352512)>] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 15:17:39 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:17:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Flow 'volume_create_manager' (d1ca9128-b0d3-4933-b4f2-3afdf56af4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:17:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e804d8-d6a1-46c4-8237-164c87c807b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:17:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e804d8-d6a1-46c4-8237-164c87c807b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=895bc68a-c690-44cb-b847-b8d6c0df3366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0993170f128444ca206f6fa4071c5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:39Z,use_quota=True,user_id='09eed2aa05db49d4a1924ffab115f0ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52842c57-1ffe-4294-8a69-048ba8686738),volume_type_id=52842c57-1ffe-4294-8a69-048ba8686738)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:17:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (723fecf2-48d9-401a-bbeb-b2d85779f8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:17:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (723fecf2-48d9-401a-bbeb-b2d85779f8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:17:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086f9abf-4897-4329-a1cd-496570357216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:17:39 devstack cinder-volume[87150]: DEBUG cinder.image.glance [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Creating Keystone auth plugin from conf {{(pid=87150) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 15:17:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086f9abf-4897-4329-a1cd-496570357216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '895bc68a-c690-44cb-b847-b8d6c0df3366', 'volume_name': 'volume-895bc68a-c690-44cb-b847-b8d6c0df3366', 'volume_size': 1, 'image_id': '50636396-6502-49be-9919-f026f75c1eb8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/50636396-6502-49be-9919-f026f75c1eb8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bebcc24bf8e4039954b5b0fbd1f36f51', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e0993170f128444ca206f6fa4071c5e0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1ae7dd5e1da607eb5737c120a260b0ce39510edc91c7ac75666a3f558133fd17bb639fc864cac7e6cb6fd98aaf770b6c5f2f2c4077d1741361bc1ff8a8211a19', 'id': '50636396-6502-49be-9919-f026f75c1eb8', 'created_at': datetime.datetime(2026, 11, 5, 14, 17, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 17, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/50636396-6502-49be-9919-f026f75c1eb8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfacec71af0>}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:17:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2e3a1da-69d6-4552-a114-316a89697f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:17:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2e3a1da-69d6-4552-a114-316a89697f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:17:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1f7f2b-760d-45e7-bdfb-6ebf725366cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:17:39 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Volume 895bc68a-c690-44cb-b847-b8d6c0df3366: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-895bc68a-c690-44cb-b847-b8d6c0df3366', 'volume_size': 1, 'image_id': '50636396-6502-49be-9919-f026f75c1eb8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/50636396-6502-49be-9919-f026f75c1eb8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bebcc24bf8e4039954b5b0fbd1f36f51', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e0993170f128444ca206f6fa4071c5e0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1ae7dd5e1da607eb5737c120a260b0ce39510edc91c7ac75666a3f558133fd17bb639fc864cac7e6cb6fd98aaf770b6c5f2f2c4077d1741361bc1ff8a8211a19', 'id': '50636396-6502-49be-9919-f026f75c1eb8', 'created_at': datetime.datetime(2026, 11, 5, 14, 17, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 17, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/50636396-6502-49be-9919-f026f75c1eb8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfacec71af0>}
Nov 05 15:17:39 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Trying to clone 895bc68a-c690-44cb-b847-b8d6c0df3366 from image 50636396-6502-49be-9919-f026f75c1eb8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/50636396-6502-49be-9919-f026f75c1eb8', 'metadata': {}}]). {{(pid=87150) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 15:17:39 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 15:17:39 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 15:17:39 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae795ef-f24c-4107-950f-ffdff69fac76]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:17:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:40 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-fdab37b3-9b10-46eb-9810-482c4ad91c7e req-681ac2f6-f31a-4951-8229-7cb6477effca tempest-TestServerVolumeAttachmentScenario-1337950484 None] Terminate volume connection completed successfully.
Nov 05 15:17:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-fdab37b3-9b10-46eb-9810-482c4ad91c7e req-681ac2f6-f31a-4951-8229-7cb6477effca tempest-TestServerVolumeAttachmentScenario-1337950484 None] Deleting attachment 5b537b4f-48fb-4271-9ed6-75ee71bda0bb. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 15:17:40 devstack sudo[103018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD
Nov 05 15:17:40 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:40 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:40 devstack sudo[103023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD
Nov 05 15:17:40 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:40 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 15:17:40 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Temporary image 50636396-6502-49be-9919-f026f75c1eb8 is fetched for user 09eed2aa05db49d4a1924ffab115f0ed. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 15:17:40 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd8a4a6-7850-4d46-9816-48efd7256d3c]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:17:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:40 devstack sudo[103028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD
Nov 05 15:17:40 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:41 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:41 devstack sudo[103032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD
Nov 05 15:17:41 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:41 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD" returned: 1 in 0.367s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 15:17:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:17:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:17:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=895bc68a-c690-44cb-b847-b8d6c0df3366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0993170f128444ca206f6fa4071c5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:39Z,use_quota=True,user_id='09eed2aa05db49d4a1924ffab115f0ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52842c57-1ffe-4294-8a69-048ba8686738),volume_type_id=52842c57-1ffe-4294-8a69-048ba8686738)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:17:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Creating volume 895bc68a-c690-44cb-b847-b8d6c0df3366 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:17:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:17:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:17:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:17:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:17:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:17:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:17:41 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:17:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-895bc68a-c690-44cb-b847-b8d6c0df3366 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:41 devstack sudo[103037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-895bc68a-c690-44cb-b847-b8d6c0df3366 1073741824
Nov 05 15:17:41 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:41 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-64036032-e7de-4d7a-b851-66b35b08acca req-1bfd20b0-a430-4bf6-8e5d-641798be356a tempest-TestServerVolumeAttachmentScenario-1337950484 None] Terminate volume connection completed successfully.
Nov 05 15:17:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-64036032-e7de-4d7a-b851-66b35b08acca req-1bfd20b0-a430-4bf6-8e5d-641798be356a tempest-TestServerVolumeAttachmentScenario-1337950484 None] Deleting attachment 030be3e9-d446-427c-9218-af39c746de6a. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 15:17:42 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-895bc68a-c690-44cb-b847-b8d6c0df3366 1073741824" returned: 0 in 0.598s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-895bc68a-c690-44cb-b847-b8d6c0df3366 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:42 devstack sudo[103070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-895bc68a-c690-44cb-b847-b8d6c0df3366
Nov 05 15:17:42 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:42 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-895bc68a-c690-44cb-b847-b8d6c0df3366" returned: 0 in 0.288s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:17:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:17:42 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Attempting download of 50636396-6502-49be-9919-f026f75c1eb8 ((None, [{'url': 'file:///opt/stack/data/glance/images/50636396-6502-49be-9919-f026f75c1eb8', 'metadata': {}}])) to volume 895bc68a-c690-44cb-b847-b8d6c0df3366. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 15:17:42 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[72163fc7-6f65-4086-a942-7fb52f21ef5b]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:17:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_50636396-6502-49be-9919-f026f75c1eb8_6_i_42a9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:42 devstack sudo[103073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_50636396-6502-49be-9919-f026f75c1eb8_6_i_42a9
Nov 05 15:17:42 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:42 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_50636396-6502-49be-9919-f026f75c1eb8_6_i_42a9" returned: 0 in 0.377s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_50636396-6502-49be-9919-f026f75c1eb8_6_i_42a9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:43 devstack sudo[103077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_50636396-6502-49be-9919-f026f75c1eb8_6_i_42a9
Nov 05 15:17:43 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:43 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_50636396-6502-49be-9919-f026f75c1eb8_6_i_42a9" returned: 1 in 0.442s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_50636396-6502-49be-9919-f026f75c1eb8_6_i_42a9' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 15:17:43 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9442960d-1c19-4388-b021-dc046e9a7ecc]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:17:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:43 devstack sudo[103101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD
Nov 05 15:17:43 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:43 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:43 devstack sudo[103105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD
Nov 05 15:17:43 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:44 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 15:17:44 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] 50636396-6502-49be-9919-f026f75c1eb8 was raw, converting to qcow2 {{(pid=87150) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 15:17:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-895bc68a-c690-44cb-b847-b8d6c0df3366 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:44 devstack sudo[103110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-895bc68a-c690-44cb-b847-b8d6c0df3366
Nov 05 15:17:44 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:44 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-895bc68a-c690-44cb-b847-b8d6c0df3366" returned: 0 in 0.769s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:44 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_50636396-6502-49be-9919-f026f75c1eb8_dk39vmandevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-895bc68a-c690-44cb-b847-b8d6c0df3366 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:17:44 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 15:17:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-895bc68a-c690-44cb-b847-b8d6c0df3366 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:44 devstack sudo[103117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-895bc68a-c690-44cb-b847-b8d6c0df3366 1G
Nov 05 15:17:44 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:45 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-895bc68a-c690-44cb-b847-b8d6c0df3366 1G" returned: 0 in 0.331s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:45 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Downloaded image 50636396-6502-49be-9919-f026f75c1eb8 ((None, [{'url': 'file:///opt/stack/data/glance/images/50636396-6502-49be-9919-f026f75c1eb8', 'metadata': {}}])) to volume 895bc68a-c690-44cb-b847-b8d6c0df3366 successfully. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 15:17:45 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Temporary image 50636396-6502-49be-9919-f026f75c1eb8 for user 09eed2aa05db49d4a1924ffab115f0ed is deleted. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 15:17:45 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Marking volume 895bc68a-c690-44cb-b847-b8d6c0df3366 as bootable. {{(pid=87150) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 15:17:45 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Copying metadata from image 50636396-6502-49be-9919-f026f75c1eb8 to 895bc68a-c690-44cb-b847-b8d6c0df3366. {{(pid=87150) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 15:17:45 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Creating volume glance metadata for volume 895bc68a-c690-44cb-b847-b8d6c0df3366 backed by image 50636396-6502-49be-9919-f026f75c1eb8 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '50636396-6502-49be-9919-f026f75c1eb8', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'bebcc24bf8e4039954b5b0fbd1f36f51', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87150) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 15:17:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1f7f2b-760d-45e7-bdfb-6ebf725366cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-895bc68a-c690-44cb-b847-b8d6c0df3366', 'volume_size': 1, 'image_id': '50636396-6502-49be-9919-f026f75c1eb8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/50636396-6502-49be-9919-f026f75c1eb8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bebcc24bf8e4039954b5b0fbd1f36f51', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e0993170f128444ca206f6fa4071c5e0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1ae7dd5e1da607eb5737c120a260b0ce39510edc91c7ac75666a3f558133fd17bb639fc864cac7e6cb6fd98aaf770b6c5f2f2c4077d1741361bc1ff8a8211a19', 'id': '50636396-6502-49be-9919-f026f75c1eb8', 'created_at': datetime.datetime(2026, 11, 5, 14, 17, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 17, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/50636396-6502-49be-9919-f026f75c1eb8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfacec71af0>}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:17:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00df0a36-85da-4fd4-ba6f-823b6460758e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:17:45 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Volume volume-895bc68a-c690-44cb-b847-b8d6c0df3366 (895bc68a-c690-44cb-b847-b8d6c0df3366): created successfully
Nov 05 15:17:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00df0a36-85da-4fd4-ba6f-823b6460758e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:17:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Flow 'volume_create_manager' (d1ca9128-b0d3-4933-b4f2-3afdf56af4b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:17:45 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a5a3e531-af97-490d-8905-d5eb13d797dc tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Created volume successfully.
Nov 05 15:17:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-919a53a3-76d4-4017-8468-db116f9721a6 tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Acquiring lock "cinder-895bc68a-c690-44cb-b847-b8d6c0df3366-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:17:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-919a53a3-76d4-4017-8468-db116f9721a6 tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Lock "cinder-895bc68a-c690-44cb-b847-b8d6c0df3366-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:17:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-919a53a3-76d4-4017-8468-db116f9721a6 tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Acquiring lock "cinder-quobyte-895bc68a-c690-44cb-b847-b8d6c0df3366" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:17:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-919a53a3-76d4-4017-8468-db116f9721a6 tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Lock "cinder-quobyte-895bc68a-c690-44cb-b847-b8d6c0df3366" acquired by "delete_volume" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:17:45 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ac6ae3-31b7-4a07-a885-311d1db390c2]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:17:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-919a53a3-76d4-4017-8468-db116f9721a6 tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-895bc68a-c690-44cb-b847-b8d6c0df3366 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:46 devstack sudo[103124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-895bc68a-c690-44cb-b847-b8d6c0df3366
Nov 05 15:17:46 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:46 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-919a53a3-76d4-4017-8468-db116f9721a6 tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-895bc68a-c690-44cb-b847-b8d6c0df3366" returned: 0 in 0.415s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-919a53a3-76d4-4017-8468-db116f9721a6 tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-895bc68a-c690-44cb-b847-b8d6c0df3366 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:46 devstack sudo[103130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-895bc68a-c690-44cb-b847-b8d6c0df3366
Nov 05 15:17:46 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8c2c8da8-d809-4e70-992c-074f193d72a2 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Acquiring lock "cinder-afe83d59-0ddd-4ca5-a935-424cc000ebf9-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:17:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8c2c8da8-d809-4e70-992c-074f193d72a2 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Lock "cinder-afe83d59-0ddd-4ca5-a935-424cc000ebf9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:17:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8c2c8da8-d809-4e70-992c-074f193d72a2 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Acquiring lock "cinder-quobyte-afe83d59-0ddd-4ca5-a935-424cc000ebf9" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:17:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8c2c8da8-d809-4e70-992c-074f193d72a2 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Lock "cinder-quobyte-afe83d59-0ddd-4ca5-a935-424cc000ebf9" acquired by "delete_volume" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:17:46 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0f95db-8b67-471c-9e07-dc5e882f82b8]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:17:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8c2c8da8-d809-4e70-992c-074f193d72a2 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-afe83d59-0ddd-4ca5-a935-424cc000ebf9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:46 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-919a53a3-76d4-4017-8468-db116f9721a6 tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-895bc68a-c690-44cb-b847-b8d6c0df3366" returned: 0 in 0.336s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-919a53a3-76d4-4017-8468-db116f9721a6 tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Lock "cinder-quobyte-895bc68a-c690-44cb-b847-b8d6c0df3366" released by "delete_volume" :: held 0.813s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:17:46 devstack cinder-volume[87150]: WARNING cinder.quota [None req-919a53a3-76d4-4017-8468-db116f9721a6 tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:17:46 devstack cinder-volume[87150]: WARNING cinder.quota [None req-919a53a3-76d4-4017-8468-db116f9721a6 tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 05 15:17:46 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-919a53a3-76d4-4017-8468-db116f9721a6 tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Created reservations ['ce5045d8-a49c-4465-9632-59c8c9f494b9', '61905e15-e468-41fc-9f63-018d3bc17852', 'ba9b0fe0-f758-4e5d-9e32-1ee102d0e908', '35e39566-2a54-4b22-9590-43ae0198f97d'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:17:46 devstack sudo[103133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-afe83d59-0ddd-4ca5-a935-424cc000ebf9
Nov 05 15:17:46 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-919a53a3-76d4-4017-8468-db116f9721a6 tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:17:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-919a53a3-76d4-4017-8468-db116f9721a6 tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:17:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-919a53a3-76d4-4017-8468-db116f9721a6 tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:17:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-919a53a3-76d4-4017-8468-db116f9721a6 tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:17:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-919a53a3-76d4-4017-8468-db116f9721a6 tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:17:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-919a53a3-76d4-4017-8468-db116f9721a6 tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:46 devstack sudo[103135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:17:46 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:47 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8c2c8da8-d809-4e70-992c-074f193d72a2 tempest-TestServerVolumeAttachmentScenario-1337950484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-afe83d59-0ddd-4ca5-a935-424cc000ebf9" returned: 0 in 0.459s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8c2c8da8-d809-4e70-992c-074f193d72a2 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-afe83d59-0ddd-4ca5-a935-424cc000ebf9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:47 devstack sudo[103140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-afe83d59-0ddd-4ca5-a935-424cc000ebf9
Nov 05 15:17:47 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:47 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-919a53a3-76d4-4017-8468-db116f9721a6 tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.297s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:47 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-919a53a3-76d4-4017-8468-db116f9721a6 tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:17:47 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-919a53a3-76d4-4017-8468-db116f9721a6 tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Deleted volume successfully.
Nov 05 15:17:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-919a53a3-76d4-4017-8468-db116f9721a6 tempest-VolumeAndVolumeTypeFromImageTest-1718581480 None] Lock "cinder-895bc68a-c690-44cb-b847-b8d6c0df3366-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:17:47 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8c2c8da8-d809-4e70-992c-074f193d72a2 tempest-TestServerVolumeAttachmentScenario-1337950484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-afe83d59-0ddd-4ca5-a935-424cc000ebf9" returned: 0 in 0.331s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8c2c8da8-d809-4e70-992c-074f193d72a2 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Lock "cinder-quobyte-afe83d59-0ddd-4ca5-a935-424cc000ebf9" released by "delete_volume" :: held 0.854s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:17:47 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-8c2c8da8-d809-4e70-992c-074f193d72a2 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Created reservations ['5886f8d6-a038-4069-bba7-1a339ef1d2ab', '9e2f809b-ddb1-4536-b724-bc96ba41604e', '3a74f989-b222-429e-ab40-b2d8bc2b0097', '3c4216b4-4508-4aff-b611-0a00daef734c'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:17:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8c2c8da8-d809-4e70-992c-074f193d72a2 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:17:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8c2c8da8-d809-4e70-992c-074f193d72a2 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:17:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8c2c8da8-d809-4e70-992c-074f193d72a2 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:17:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8c2c8da8-d809-4e70-992c-074f193d72a2 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:17:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8c2c8da8-d809-4e70-992c-074f193d72a2 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:17:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8c2c8da8-d809-4e70-992c-074f193d72a2 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:47 devstack sudo[103144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:17:47 devstack sudo[103144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e31e0284-b86e-41e9-8c06-3656f78f849f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Acquiring lock "cinder-1547b30c-4653-4fec-9343-e3cfa76f9a65-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:17:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e31e0284-b86e-41e9-8c06-3656f78f849f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Lock "cinder-1547b30c-4653-4fec-9343-e3cfa76f9a65-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:17:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e31e0284-b86e-41e9-8c06-3656f78f849f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Acquiring lock "cinder-quobyte-1547b30c-4653-4fec-9343-e3cfa76f9a65" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:17:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e31e0284-b86e-41e9-8c06-3656f78f849f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Lock "cinder-quobyte-1547b30c-4653-4fec-9343-e3cfa76f9a65" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:17:47 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9971b1cd-e467-4080-a81c-fb102dc75997]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:17:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e31e0284-b86e-41e9-8c06-3656f78f849f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1547b30c-4653-4fec-9343-e3cfa76f9a65 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:48 devstack sudo[103144]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8c2c8da8-d809-4e70-992c-074f193d72a2 tempest-TestServerVolumeAttachmentScenario-1337950484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.364s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:48 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-8c2c8da8-d809-4e70-992c-074f193d72a2 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:17:48 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-8c2c8da8-d809-4e70-992c-074f193d72a2 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Deleted volume successfully.
Nov 05 15:17:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8c2c8da8-d809-4e70-992c-074f193d72a2 tempest-TestServerVolumeAttachmentScenario-1337950484 None] Lock "cinder-afe83d59-0ddd-4ca5-a935-424cc000ebf9-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:17:48 devstack sudo[103147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1547b30c-4653-4fec-9343-e3cfa76f9a65
Nov 05 15:17:48 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:48 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e31e0284-b86e-41e9-8c06-3656f78f849f tempest-TestServerVolumeAttachmentScenario-1337950484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1547b30c-4653-4fec-9343-e3cfa76f9a65" returned: 0 in 0.429s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e31e0284-b86e-41e9-8c06-3656f78f849f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1547b30c-4653-4fec-9343-e3cfa76f9a65 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:48 devstack sudo[103153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1547b30c-4653-4fec-9343-e3cfa76f9a65
Nov 05 15:17:48 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:48 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e31e0284-b86e-41e9-8c06-3656f78f849f tempest-TestServerVolumeAttachmentScenario-1337950484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1547b30c-4653-4fec-9343-e3cfa76f9a65" returned: 0 in 0.278s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e31e0284-b86e-41e9-8c06-3656f78f849f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Lock "cinder-quobyte-1547b30c-4653-4fec-9343-e3cfa76f9a65" released by "delete_volume" :: held 0.779s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:17:48 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-e31e0284-b86e-41e9-8c06-3656f78f849f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Created reservations ['378c1606-50d4-4833-89b3-f4c794abb99c', '2970fffc-7038-4069-aee1-51a9e0080181', 'fb109254-65cd-49e7-8522-f42780a3727f', '0a83ac9f-6e30-4c4a-b7a0-19c7ea1adc29'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:17:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e31e0284-b86e-41e9-8c06-3656f78f849f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:17:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e31e0284-b86e-41e9-8c06-3656f78f849f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:17:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e31e0284-b86e-41e9-8c06-3656f78f849f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:17:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e31e0284-b86e-41e9-8c06-3656f78f849f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:17:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e31e0284-b86e-41e9-8c06-3656f78f849f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:17:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e31e0284-b86e-41e9-8c06-3656f78f849f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:48 devstack sudo[103156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:17:48 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:49 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e31e0284-b86e-41e9-8c06-3656f78f849f tempest-TestServerVolumeAttachmentScenario-1337950484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.353s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:49 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-e31e0284-b86e-41e9-8c06-3656f78f849f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:17:49 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e31e0284-b86e-41e9-8c06-3656f78f849f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Deleted volume successfully.
Nov 05 15:17:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e31e0284-b86e-41e9-8c06-3656f78f849f tempest-TestServerVolumeAttachmentScenario-1337950484 None] Lock "cinder-1547b30c-4653-4fec-9343-e3cfa76f9a65-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:17:51 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:17:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Flow 'volume_create_manager' (569b118c-967e-43ce-bdc4-632a52f92c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:17:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (077909a2-f9c9-489b-beb4-855d9de388e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:17:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (077909a2-f9c9-489b-beb4-855d9de388e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-90019558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122b572328e44c8eb965d86744413e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:51Z,use_quota=True,user_id='bf31eddef93a46f680ade02d1cac6def',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:17:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc3e4ab-d5f4-4902-b363-8776c2a55acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:17:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc3e4ab-d5f4-4902-b363-8776c2a55acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:17:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0284ee61-a3f3-4ba8-a31d-344a61eb0019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:17:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0284ee61-a3f3-4ba8-a31d-344a61eb0019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb', 'volume_name': 'volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:17:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e97acc-83d6-4ab1-98dd-b9b2612a9fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:17:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e97acc-83d6-4ab1-98dd-b9b2612a9fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:17:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (580d9623-b761-4279-9eb3-ee6cdc5fc340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:17:51 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Volume cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb', 'volume_size': 1}
Nov 05 15:17:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:17:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:17:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-90019558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122b572328e44c8eb965d86744413e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:51Z,use_quota=True,user_id='bf31eddef93a46f680ade02d1cac6def',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:17:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Creating volume cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:17:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:17:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:17:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:17:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:17:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:17:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:17:51 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:17:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:51 devstack sudo[103161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb 1073741824
Nov 05 15:17:51 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:51 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb 1073741824" returned: 0 in 0.541s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:17:51 devstack sudo[103167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb
Nov 05 15:17:51 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:17:52 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root
Nov 05 15:17:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb" returned: 0 in 0.279s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:17:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:17:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:17:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (580d9623-b761-4279-9eb3-ee6cdc5fc340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:17:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed99e81-cde5-45a8-85c5-8e93d6b55e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:17:52 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Volume volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb (cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb): created successfully
Nov 05 15:17:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed99e81-cde5-45a8-85c5-8e93d6b55e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:17:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Flow 'volume_create_manager' (569b118c-967e-43ce-bdc4-632a52f92c47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:17:52 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9852dfa4-e47d-48fb-a27b-23790ad337ae tempest-VolumesActionsTest-2144767496 None] Created volume successfully.
Nov 05 15:18:02 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=68,cinder:UPDATE=69,cinder:DELETE=7,cinder:INSERT=18 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:18:02 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=70,cinder:INSERT=22,cinder:SELECT=53,cinder:DELETE=5 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:18:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-12bdf182-daa5-4913-8734-8cbf670f8e3a tempest-VolumesActionsTest-2144767496 None] Acquiring lock "cinder-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb" by "attach_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:18:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-12bdf182-daa5-4913-8734-8cbf670f8e3a tempest-VolumesActionsTest-2144767496 None] Lock "cinder-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb" acquired by "attach_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:18:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-12bdf182-daa5-4913-8734-8cbf670f8e3a tempest-VolumesActionsTest-2144767496 None] Attaching volume cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb to instance dfb0a4fa-e8a4-45cf-a485-bbaa05adfa26 at mountpoint /dev/vdb on host None.
Nov 05 15:18:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-12bdf182-daa5-4913-8734-8cbf670f8e3a tempest-VolumesActionsTest-2144767496 None] Attach volume completed successfully.
Nov 05 15:18:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-12bdf182-daa5-4913-8734-8cbf670f8e3a tempest-VolumesActionsTest-2144767496 None] Lock "cinder-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb" released by "attach_volume" :: held 0.111s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:18:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3235e9ed-07e9-485a-9b74-03630977e776 tempest-VolumesActionsTest-2144767496 None] Acquiring lock "cinder-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb-detach_volume" by "detach_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:18:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3235e9ed-07e9-485a-9b74-03630977e776 tempest-VolumesActionsTest-2144767496 None] Lock "cinder-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:18:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3235e9ed-07e9-485a-9b74-03630977e776 tempest-VolumesActionsTest-2144767496 None] Detaching volume cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb from instance dfb0a4fa-e8a4-45cf-a485-bbaa05adfa26.
Nov 05 15:18:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3235e9ed-07e9-485a-9b74-03630977e776 tempest-VolumesActionsTest-2144767496 None] Detach volume completed successfully.
Nov 05 15:18:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3235e9ed-07e9-485a-9b74-03630977e776 tempest-VolumesActionsTest-2144767496 None] Lock "cinder-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb-detach_volume" released by "detach_volume" :: held 0.091s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:18:13 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:18:13 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:INSERT=1,cinder:SELECT=6,cinder:UPDATE=3 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:18:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b63f015f-05f5-489d-8d76-5c20ba95121e tempest-VolumesActionsTest-2144767496 None] Acquiring lock "cinder-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb" by "attach_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:18:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b63f015f-05f5-489d-8d76-5c20ba95121e tempest-VolumesActionsTest-2144767496 None] Lock "cinder-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb" acquired by "attach_volume" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:18:15 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b63f015f-05f5-489d-8d76-5c20ba95121e tempest-VolumesActionsTest-2144767496 None] Attaching volume cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb to instance 4858cb69-3b3f-4169-b0e2-f99051f96667 at mountpoint /dev/vdb on host None.
Nov 05 15:18:15 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b63f015f-05f5-489d-8d76-5c20ba95121e tempest-VolumesActionsTest-2144767496 None] Attach volume completed successfully.
Nov 05 15:18:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b63f015f-05f5-489d-8d76-5c20ba95121e tempest-VolumesActionsTest-2144767496 None] Lock "cinder-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb" released by "attach_volume" :: held 0.133s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:18:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f57590ea-d4bf-46c2-af8b-045dfac20450 tempest-VolumesActionsTest-2144767496 None] Acquiring lock "cinder-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb-detach_volume" by "detach_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:18:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f57590ea-d4bf-46c2-af8b-045dfac20450 tempest-VolumesActionsTest-2144767496 None] Lock "cinder-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:18:16 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f57590ea-d4bf-46c2-af8b-045dfac20450 tempest-VolumesActionsTest-2144767496 None] Detaching volume cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb from instance 4858cb69-3b3f-4169-b0e2-f99051f96667.
Nov 05 15:18:16 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f57590ea-d4bf-46c2-af8b-045dfac20450 tempest-VolumesActionsTest-2144767496 None] Detach volume completed successfully.
Nov 05 15:18:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f57590ea-d4bf-46c2-af8b-045dfac20450 tempest-VolumesActionsTest-2144767496 None] Lock "cinder-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb-detach_volume" released by "detach_volume" :: held 0.119s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:18:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-76262a30-f764-4ebc-a9ef-9a7d14cf7d42 tempest-VolumesActionsTest-2144767496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:18:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-76262a30-f764-4ebc-a9ef-9a7d14cf7d42 tempest-VolumesActionsTest-2144767496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:18:21 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81f9a1f-39c5-4a7a-b916-8cd1fc538380]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:18:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-76262a30-f764-4ebc-a9ef-9a7d14cf7d42 tempest-VolumesActionsTest-2144767496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:18:21 devstack sudo[103420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb
Nov 05 15:18:21 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:18:21 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root
Nov 05 15:18:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-76262a30-f764-4ebc-a9ef-9a7d14cf7d42 tempest-VolumesActionsTest-2144767496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb" returned: 0 in 0.373s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:18:21 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5470814-e759-44e8-9cbd-d84005ea65e6]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:18:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-76262a30-f764-4ebc-a9ef-9a7d14cf7d42 tempest-VolumesActionsTest-2144767496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:18:21 devstack sudo[103425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb
Nov 05 15:18:21 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:18:22 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root
Nov 05 15:18:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-76262a30-f764-4ebc-a9ef-9a7d14cf7d42 tempest-VolumesActionsTest-2144767496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb" returned: 0 in 0.453s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:18:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-76262a30-f764-4ebc-a9ef-9a7d14cf7d42 tempest-VolumesActionsTest-2144767496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb /opt/stack/data/cinder/conversion/cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb.temp_image.c6b0f2cb-8106-464d-9f1d-a9704dc036bcdlxdzlb4.img {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:18:22 devstack sudo[103430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb /opt/stack/data/cinder/conversion/cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb.temp_image.c6b0f2cb-8106-464d-9f1d-a9704dc036bcdlxdzlb4.img
Nov 05 15:18:22 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:18:29 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root
Nov 05 15:18:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-76262a30-f764-4ebc-a9ef-9a7d14cf7d42 tempest-VolumesActionsTest-2144767496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb /opt/stack/data/cinder/conversion/cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb.temp_image.c6b0f2cb-8106-464d-9f1d-a9704dc036bcdlxdzlb4.img" returned: 0 in 7.376s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:18:29 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27912c1-f661-4a95-807d-7b858731a843]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:18:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-76262a30-f764-4ebc-a9ef-9a7d14cf7d42 tempest-VolumesActionsTest-2144767496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:18:29 devstack sudo[103482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb
Nov 05 15:18:29 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:18:30 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root
Nov 05 15:18:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-76262a30-f764-4ebc-a9ef-9a7d14cf7d42 tempest-VolumesActionsTest-2144767496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb" returned: 0 in 0.606s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:18:30 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-76262a30-f764-4ebc-a9ef-9a7d14cf7d42 tempest-VolumesActionsTest-2144767496 None] Image conversion details: src /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb, size 1024.00 MB, duration 7.38 sec, destination /opt/stack/data/cinder/conversion/cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb.temp_image.c6b0f2cb-8106-464d-9f1d-a9704dc036bcdlxdzlb4.img {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:18:30 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-76262a30-f764-4ebc-a9ef-9a7d14cf7d42 tempest-VolumesActionsTest-2144767496 None] Converted 1024.00 MB image at 138.80 MB/s
Nov 05 15:18:30 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-76262a30-f764-4ebc-a9ef-9a7d14cf7d42 tempest-VolumesActionsTest-2144767496 None] c6b0f2cb-8106-464d-9f1d-a9704dc036bc was raw, no need to convert to raw {{(pid=87150) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 05 15:18:34 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:18:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Flow 'volume_create_manager' (77de34b4-432e-4f71-af4c-590b0c4f2c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:18:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64fb6de-74b8-4774-8dcd-e099cd8eed9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:18:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64fb6de-74b8-4774-8dcd-e099cd8eed9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-462326178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14023c80-0f92-4f5a-90fa-8a5d3072df2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a96a25ad3346fda8ab6fd5e9bc11fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:18:35Z,use_quota=True,user_id='fb4920a6fd3e4beaa18653a8c636bbce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:18:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ad93bc-8c66-42c0-814d-dae397cdba6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:18:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ad93bc-8c66-42c0-814d-dae397cdba6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:18:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89f7a19-a85d-4c4d-a66f-4ee93b21ae91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:18:34 devstack cinder-volume[87150]: DEBUG cinder.image.glance [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Creating Keystone auth plugin from conf {{(pid=87150) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 15:18:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89f7a19-a85d-4c4d-a66f-4ee93b21ae91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '14023c80-0f92-4f5a-90fa-8a5d3072df2d', 'volume_name': 'volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d', 'volume_size': 1, 'image_id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4a6a2406cd83415e894eebbb1d6b51ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'created_at': datetime.datetime(2026, 11, 5, 13, 57, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21a5d804-2425-4adb-8e07-60d978b4be84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfaced1c3b0>}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:18:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34122dfb-fce9-4429-a53c-a298273b79ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:18:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34122dfb-fce9-4429-a53c-a298273b79ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:18:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c65ec74-7fee-4098-9c69-8a47387a7e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:18:35 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Volume 14023c80-0f92-4f5a-90fa-8a5d3072df2d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d', 'volume_size': 1, 'image_id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4a6a2406cd83415e894eebbb1d6b51ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'created_at': datetime.datetime(2026, 11, 5, 13, 57, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21a5d804-2425-4adb-8e07-60d978b4be84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfaced1c3b0>}
Nov 05 15:18:35 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Trying to clone 14023c80-0f92-4f5a-90fa-8a5d3072df2d from image 21a5d804-2425-4adb-8e07-60d978b4be84 at location (None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}]). {{(pid=87150) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 15:18:35 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_ecv179zxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 15:18:35 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 15:18:35 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d801b201-3601-436e-9977-2254b9e7b007]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:18:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_ecv179zxdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:18:35 devstack sudo[103490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_ecv179zxdevstack@QuobyteHD
Nov 05 15:18:35 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:18:35 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root
Nov 05 15:18:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_ecv179zxdevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:18:35 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Temporary image 21a5d804-2425-4adb-8e07-60d978b4be84 is fetched for user fb4920a6fd3e4beaa18653a8c636bbce. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 15:18:36 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ee6506-26cb-42da-9776-9e7247118927]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:18:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_ecv179zxdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:18:36 devstack sudo[103495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_ecv179zxdevstack@QuobyteHD
Nov 05 15:18:36 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:18:36 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root
Nov 05 15:18:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_ecv179zxdevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:18:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:18:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:18:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:18:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:18:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:18:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:18:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:18:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:18:37 devstack sudo[103500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:18:37 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:18:37 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root
Nov 05 15:18:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.282s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:18:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:18:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:18:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 15:18:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread info: [<_MainThread(MainThread, started 136317437956224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136317326340928)>, <Thread(Thread-3 (stat_writer), started daemon 136317326487936)>, <Thread(Rabbit-heartbeat, started daemon 136317321464000)>, <Thread(Thread-5 (_runner), started daemon 136317321550592)>, <Thread(Thread-7 (_runner), started daemon 136317321658496)>, <Thread(fd_logger, started daemon 136317319612992)>, <Thread(privsep_reader, started daemon 136317319622400)>, <Thread(tpool_thread_0, started daemon 136317310928576)>, <Thread(tpool_thread_1, started daemon 136317302535872)>, <Thread(tpool_thread_2, started daemon 136317294143168)>, <Thread(tpool_thread_3, started daemon 136317285750464)>, <Thread(tpool_thread_4, started daemon 136317277357760)>, <Thread(tpool_thread_5, started daemon 136317268965056)>, <Thread(tpool_thread_6, started daemon 136317260572352)>, <Thread(tpool_thread_7, started daemon 136317252179648)>, <Thread(tpool_thread_8, started daemon 136317243786944)>, <Thread(tpool_thread_9, started daemon 136317235394240)>, <Thread(tpool_thread_10, started daemon 136317227001536)>, <Thread(tpool_thread_11, started daemon 136317218608832)>, <Thread(tpool_thread_12, started daemon 136317210216128)>, <Thread(tpool_thread_13, started daemon 136317201807040)>, <Thread(tpool_thread_14, started daemon 136317193397952)>, <Thread(tpool_thread_15, started daemon 136317184988864)>, <Thread(tpool_thread_16, started daemon 136317176579776)>, <Thread(tpool_thread_17, started daemon 136317168170688)>, <Thread(tpool_thread_18, started daemon 136317159761600)>, <Thread(tpool_thread_19, started daemon 136317151352512)>] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 15:18:45 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=12,cinder:UPDATE=5 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:18:45 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=9,cinder:INSERT=3,cinder:UPDATE=3 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:18:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-76262a30-f764-4ebc-a9ef-9a7d14cf7d42 tempest-VolumesActionsTest-2144767496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.418s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:18:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-76262a30-f764-4ebc-a9ef-9a7d14cf7d42 tempest-VolumesActionsTest-2144767496 None] Uploaded volume to glance image-id: c6b0f2cb-8106-464d-9f1d-a9704dc036bc. {{(pid=87150) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 05 15:18:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.516s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:18:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-462326178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14023c80-0f92-4f5a-90fa-8a5d3072df2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a96a25ad3346fda8ab6fd5e9bc11fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:18:35Z,use_quota=True,user_id='fb4920a6fd3e4beaa18653a8c636bbce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:18:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Creating volume 14023c80-0f92-4f5a-90fa-8a5d3072df2d {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:18:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:18:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:18:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:18:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:18:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:18:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:18:48 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:18:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:18:48 devstack sudo[103505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d 1073741824
Nov 05 15:18:48 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:18:48 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-76262a30-f764-4ebc-a9ef-9a7d14cf7d42 tempest-VolumesActionsTest-2144767496 None] Copy volume to image completed successfully.
Nov 05 15:18:49 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root
Nov 05 15:18:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d 1073741824" returned: 0 in 0.389s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:18:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:18:49 devstack sudo[103512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d
Nov 05 15:18:49 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:18:49 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root
Nov 05 15:18:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d" returned: 0 in 0.244s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:18:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:18:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:18:49 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Attempting download of 21a5d804-2425-4adb-8e07-60d978b4be84 ((None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}])) to volume 14023c80-0f92-4f5a-90fa-8a5d3072df2d. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 15:18:49 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1deb59-8e0b-4284-8e74-da748158f2b1]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:18:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_kutw99u4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:18:49 devstack sudo[103515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_kutw99u4
Nov 05 15:18:49 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:18:49 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root
Nov 05 15:18:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_kutw99u4" returned: 0 in 0.333s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:18:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_kutw99u4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:18:50 devstack sudo[103519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_kutw99u4
Nov 05 15:18:50 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:18:50 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root
Nov 05 15:18:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_kutw99u4" returned: 1 in 0.333s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:18:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21a5d804-2425-4adb-8e07-60d978b4be84_kutw99u4' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 15:18:50 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d2780d-850e-4516-b6f1-b18b3d727489]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:18:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_ecv179zxdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:18:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:18:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:18:50 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93ef2cb-3f6c-495e-9aae-c39196cbaabf]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:18:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:18:50 devstack sudo[103523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_ecv179zxdevstack@QuobyteHD
Nov 05 15:18:50 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:18:50 devstack sudo[103524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb
Nov 05 15:18:50 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:18:50 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root
Nov 05 15:18:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_ecv179zxdevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:18:50 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] 21a5d804-2425-4adb-8e07-60d978b4be84 was qcow2, converting to qcow2 {{(pid=87150) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 15:18:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_ecv179zxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:18:50 devstack sudo[103530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_ecv179zxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d
Nov 05 15:18:50 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:18:50 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root
Nov 05 15:18:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb" returned: 0 in 0.374s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:18:50 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fb95ee-53de-4449-b5bd-29e092257179]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:18:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:18:50 devstack sudo[103535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb
Nov 05 15:18:50 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:18:51 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root
Nov 05 15:18:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb" returned: 0 in 0.389s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:18:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb /opt/stack/data/cinder/conversion/cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb.temp_image.3e7aeab5-8782-499d-85fb-1f0e355d18219nqkawsb.img {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:18:51 devstack sudo[103548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb /opt/stack/data/cinder/conversion/cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb.temp_image.3e7aeab5-8782-499d-85fb-1f0e355d18219nqkawsb.img
Nov 05 15:18:51 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:18:54 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root
Nov 05 15:18:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_ecv179zxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d" returned: 0 in 3.364s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:18:54 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_21a5d804-2425-4adb-8e07-60d978b4be84_ecv179zxdevstack@QuobyteHD, size 112.00 MB, duration 3.37 sec, destination /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:18:54 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Converted 112.00 MB image at 33.28 MB/s
Nov 05 15:18:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:18:54 devstack sudo[103560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d 1G
Nov 05 15:18:54 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:18:54 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root
Nov 05 15:18:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d 1G" returned: 0 in 0.528s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:18:54 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Downloaded image 21a5d804-2425-4adb-8e07-60d978b4be84 ((None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}])) to volume 14023c80-0f92-4f5a-90fa-8a5d3072df2d successfully. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 15:18:54 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Temporary image 21a5d804-2425-4adb-8e07-60d978b4be84 for user fb4920a6fd3e4beaa18653a8c636bbce is deleted. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 15:18:54 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Marking volume 14023c80-0f92-4f5a-90fa-8a5d3072df2d as bootable. {{(pid=87150) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 15:18:54 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Copying metadata from image 21a5d804-2425-4adb-8e07-60d978b4be84 to 14023c80-0f92-4f5a-90fa-8a5d3072df2d. {{(pid=87150) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 15:18:54 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Creating volume glance metadata for volume 14023c80-0f92-4f5a-90fa-8a5d3072df2d backed by image 21a5d804-2425-4adb-8e07-60d978b4be84 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87150) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 15:18:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c65ec74-7fee-4098-9c69-8a47387a7e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d', 'volume_size': 1, 'image_id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21a5d804-2425-4adb-8e07-60d978b4be84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4a6a2406cd83415e894eebbb1d6b51ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21a5d804-2425-4adb-8e07-60d978b4be84', 'created_at': datetime.datetime(2026, 11, 5, 13, 57, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21a5d804-2425-4adb-8e07-60d978b4be84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfaced1c3b0>}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:18:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35421ef8-9e6b-4fa5-a853-c42e74d2ecb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:18:54 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Volume volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d (14023c80-0f92-4f5a-90fa-8a5d3072df2d): created successfully
Nov 05 15:18:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35421ef8-9e6b-4fa5-a853-c42e74d2ecb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:18:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Flow 'volume_create_manager' (77de34b4-432e-4f71-af4c-590b0c4f2c8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:18:54 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-bac7dd51-1c9c-44ac-bd26-e9844d5fc764 tempest-TestShelveInstance-392259644 None] Created volume successfully.
Nov 05 15:18:57 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root
Nov 05 15:18:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb /opt/stack/data/cinder/conversion/cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb.temp_image.3e7aeab5-8782-499d-85fb-1f0e355d18219nqkawsb.img" returned: 0 in 6.528s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:18:57 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc39051-a7bb-4445-97d5-2c66eeedcf4a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:18:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:18:57 devstack sudo[103570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb
Nov 05 15:18:57 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:18:58 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root
Nov 05 15:18:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb" returned: 0 in 0.558s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:18:58 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] Image conversion details: src /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb, size 1024.00 MB, duration 6.53 sec, destination /opt/stack/data/cinder/conversion/cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb.temp_image.3e7aeab5-8782-499d-85fb-1f0e355d18219nqkawsb.img {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:18:58 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] Converted 1024.00 MB image at 156.81 MB/s
Nov 05 15:18:58 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] 3e7aeab5-8782-499d-85fb-1f0e355d1821 was raw, converting to qcow2 {{(pid=87150) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Nov 05 15:18:58 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4723d20-e8d4-403d-90b3-803052b088f9]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:18:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb.temp_image.3e7aeab5-8782-499d-85fb-1f0e355d18219nqkawsb.img {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:18:58 devstack sudo[103575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb.temp_image.3e7aeab5-8782-499d-85fb-1f0e355d18219nqkawsb.img
Nov 05 15:18:58 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:18:58 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root
Nov 05 15:18:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb.temp_image.3e7aeab5-8782-499d-85fb-1f0e355d18219nqkawsb.img" returned: 0 in 0.358s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:18:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb.temp_image.3e7aeab5-8782-499d-85fb-1f0e355d18219nqkawsb.img {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:18:58 devstack sudo[103579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb.temp_image.3e7aeab5-8782-499d-85fb-1f0e355d18219nqkawsb.img
Nov 05 15:18:58 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:18:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-db475ece-3797-4d5c-a04b-04c7b513d783 req-aecd5600-a0ce-41b1-876f-f41e0c971dd4 tempest-TestShelveInstance-392259644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:18:59 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root
Nov 05 15:18:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb.temp_image.3e7aeab5-8782-499d-85fb-1f0e355d18219nqkawsb.img" returned: 1 in 0.383s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:18:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb.temp_image.3e7aeab5-8782-499d-85fb-1f0e355d18219nqkawsb.img' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 15:18:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb.temp_image.3e7aeab5-8782-499d-85fb-1f0e355d18219nqkawsb.img /opt/stack/data/cinder/conversion/vol_upload_dyfnfnv4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:18:59 devstack sudo[103592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb.temp_image.3e7aeab5-8782-499d-85fb-1f0e355d18219nqkawsb.img /opt/stack/data/cinder/conversion/vol_upload_dyfnfnv4
Nov 05 15:18:59 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:18:59 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root
Nov 05 15:18:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb.temp_image.3e7aeab5-8782-499d-85fb-1f0e355d18219nqkawsb.img /opt/stack/data/cinder/conversion/vol_upload_dyfnfnv4" returned: 0 in 0.253s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:18:59 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] Image conversion details: src /opt/stack/data/cinder/conversion/cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb.temp_image.3e7aeab5-8782-499d-85fb-1f0e355d18219nqkawsb.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_dyfnfnv4 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:18:59 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] Converted 1024.00 MB image at 1024.00 MB/s
Nov 05 15:18:59 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4affd218-722e-4b58-96fc-3e8b82ef89c5]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:18:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dyfnfnv4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:18:59 devstack sudo[103599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dyfnfnv4
Nov 05 15:18:59 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:18:59 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root
Nov 05 15:18:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dyfnfnv4" returned: 0 in 0.414s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.690s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:19:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] Uploaded volume to glance image-id: 3e7aeab5-8782-499d-85fb-1f0e355d1821. {{(pid=87150) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 05 15:19:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-db475ece-3797-4d5c-a04b-04c7b513d783 req-aecd5600-a0ce-41b1-876f-f41e0c971dd4 tempest-TestShelveInstance-392259644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.036s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:19:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-db475ece-3797-4d5c-a04b-04c7b513d783 req-aecd5600-a0ce-41b1-876f-f41e0c971dd4 tempest-TestShelveInstance-392259644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:19:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5c455161-02a0-4aad-a4b5-cd03bee9a811 tempest-VolumesActionsTest-2144767496 None] Copy volume to image completed successfully.
Nov 05 15:19:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-db475ece-3797-4d5c-a04b-04c7b513d783 req-aecd5600-a0ce-41b1-876f-f41e0c971dd4 tempest-TestShelveInstance-392259644 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628', 'name': 'volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7c7d0bc-6f6f-4cb0-973a-981710b6ebb2', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 15:19:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-db475ece-3797-4d5c-a04b-04c7b513d783 req-aecd5600-a0ce-41b1-876f-f41e0c971dd4 tempest-TestShelveInstance-392259644 None] attachment_update completed successfully.
Nov 05 15:19:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7597d894-c957-491f-94d0-96c1517f6571 tempest-VolumesActionsTest-2144767496 None] Acquiring lock "cinder-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:19:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7597d894-c957-491f-94d0-96c1517f6571 tempest-VolumesActionsTest-2144767496 None] Lock "cinder-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:19:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7597d894-c957-491f-94d0-96c1517f6571 tempest-VolumesActionsTest-2144767496 None] Acquiring lock "cinder-quobyte-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:19:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7597d894-c957-491f-94d0-96c1517f6571 tempest-VolumesActionsTest-2144767496 None] Lock "cinder-quobyte-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb" acquired by "delete_volume" :: waited 0.047s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:19:03 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[388c6a31-abbc-4450-9d2e-2120363889eb]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:19:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7597d894-c957-491f-94d0-96c1517f6571 tempest-VolumesActionsTest-2144767496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:19:03 devstack sudo[104071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb
Nov 05 15:19:03 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:19:03 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root
Nov 05 15:19:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7597d894-c957-491f-94d0-96c1517f6571 tempest-VolumesActionsTest-2144767496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb" returned: 0 in 0.467s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7597d894-c957-491f-94d0-96c1517f6571 tempest-VolumesActionsTest-2144767496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:19:03 devstack sudo[104087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb
Nov 05 15:19:03 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:19:03 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root
Nov 05 15:19:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7597d894-c957-491f-94d0-96c1517f6571 tempest-VolumesActionsTest-2144767496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb" returned: 0 in 0.250s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7597d894-c957-491f-94d0-96c1517f6571 tempest-VolumesActionsTest-2144767496 None] Lock "cinder-quobyte-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb" released by "delete_volume" :: held 0.777s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:19:03 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-7597d894-c957-491f-94d0-96c1517f6571 tempest-VolumesActionsTest-2144767496 None] Created reservations ['c53704f8-d0d2-44e5-b23c-42e48dd16056', '87dd77cd-98e0-4404-8dbf-5efac00e7af1', '40a0be06-1b03-4b27-859b-62d3a75443e4', '3a1e44bd-3cbe-4320-956f-361422ea38fc'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:19:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7597d894-c957-491f-94d0-96c1517f6571 tempest-VolumesActionsTest-2144767496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:19:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7597d894-c957-491f-94d0-96c1517f6571 tempest-VolumesActionsTest-2144767496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:19:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7597d894-c957-491f-94d0-96c1517f6571 tempest-VolumesActionsTest-2144767496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:19:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7597d894-c957-491f-94d0-96c1517f6571 tempest-VolumesActionsTest-2144767496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:19:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7597d894-c957-491f-94d0-96c1517f6571 tempest-VolumesActionsTest-2144767496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:19:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7597d894-c957-491f-94d0-96c1517f6571 tempest-VolumesActionsTest-2144767496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:19:03 devstack sudo[104090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:19:03 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:19:04 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root
Nov 05 15:19:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7597d894-c957-491f-94d0-96c1517f6571 tempest-VolumesActionsTest-2144767496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.398s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:04 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-7597d894-c957-491f-94d0-96c1517f6571 tempest-VolumesActionsTest-2144767496 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:19:04 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7597d894-c957-491f-94d0-96c1517f6571 tempest-VolumesActionsTest-2144767496 None] Deleted volume successfully.
Nov 05 15:19:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7597d894-c957-491f-94d0-96c1517f6571 tempest-VolumesActionsTest-2144767496 None] Lock "cinder-cc46ebc3-de06-408a-b5fb-0cdbd3c58bfb-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:19:12 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:19:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Flow 'volume_create_manager' (a8293950-baf6-4694-9b60-52bf39fd1e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:19:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86274fe9-d9c6-456e-881b-46f9f1302451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:19:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86274fe9-d9c6-456e-881b-46f9f1302451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1739465533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13506cdc-f399-418e-8fee-eeee8991feba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='19e6ab382f9443d990609ca24b946ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:19:12Z,use_quota=True,user_id='5abf58a48fc8429a98cec3b799c317fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:19:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95a81ed-1aea-431a-a926-da0f4ef4f880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:19:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95a81ed-1aea-431a-a926-da0f4ef4f880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:19:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae8e4647-de4a-4245-968b-7c0765d4ee99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:19:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae8e4647-de4a-4245-968b-7c0765d4ee99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13506cdc-f399-418e-8fee-eeee8991feba', 'volume_name': 'volume-13506cdc-f399-418e-8fee-eeee8991feba', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:19:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51778335-bd08-49b4-974d-a7f04adf0893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:19:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51778335-bd08-49b4-974d-a7f04adf0893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:19:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e05cab-feb8-4b0c-a9e1-66deca9bf6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:19:12 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Volume 13506cdc-f399-418e-8fee-eeee8991feba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13506cdc-f399-418e-8fee-eeee8991feba', 'volume_size': 1}
Nov 05 15:19:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:19:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:19:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1739465533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13506cdc-f399-418e-8fee-eeee8991feba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='19e6ab382f9443d990609ca24b946ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:19:12Z,use_quota=True,user_id='5abf58a48fc8429a98cec3b799c317fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:19:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Creating volume 13506cdc-f399-418e-8fee-eeee8991feba {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:19:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:19:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:19:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:19:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:19:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:19:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:19:12 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:19:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-13506cdc-f399-418e-8fee-eeee8991feba 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:19:12 devstack sudo[104101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-13506cdc-f399-418e-8fee-eeee8991feba 1073741824
Nov 05 15:19:12 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:19:12 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root
Nov 05 15:19:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-13506cdc-f399-418e-8fee-eeee8991feba 1073741824" returned: 0 in 0.429s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-13506cdc-f399-418e-8fee-eeee8991feba {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:19:12 devstack sudo[104106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-13506cdc-f399-418e-8fee-eeee8991feba
Nov 05 15:19:12 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:19:13 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-13506cdc-f399-418e-8fee-eeee8991feba" returned: 0 in 0.247s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e05cab-feb8-4b0c-a9e1-66deca9bf6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13506cdc-f399-418e-8fee-eeee8991feba', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcaef986-9d8a-4971-b17c-605cad59841d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:19:13 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Volume volume-13506cdc-f399-418e-8fee-eeee8991feba (13506cdc-f399-418e-8fee-eeee8991feba): created successfully
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcaef986-9d8a-4971-b17c-605cad59841d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Flow 'volume_create_manager' (a8293950-baf6-4694-9b60-52bf39fd1e61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:19:13 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-11b7cc65-1942-4fbb-a3b2-42407900dc78 tempest-VolumesListTestJSON-1885868040 None] Created volume successfully.
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Flow 'volume_create_manager' (b348387a-0ee0-4da8-b173-37e620aa28ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a9928c0-a730-4741-bc85-17503f2d7715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a9928c0-a730-4741-bc85-17503f2d7715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1742967054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd814535-49c1-487f-9e23-d6d6091b6e38,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='19e6ab382f9443d990609ca24b946ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:19:14Z,use_quota=True,user_id='5abf58a48fc8429a98cec3b799c317fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad65fbbb-1b84-4aba-880a-51aa4ef48780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad65fbbb-1b84-4aba-880a-51aa4ef48780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe1c2b53-64be-4ef4-9e2c-84a2b79e9852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe1c2b53-64be-4ef4-9e2c-84a2b79e9852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd814535-49c1-487f-9e23-d6d6091b6e38', 'volume_name': 'volume-cd814535-49c1-487f-9e23-d6d6091b6e38', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027ebd09-a40f-499b-b5f4-6b06af851515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027ebd09-a40f-499b-b5f4-6b06af851515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ebd794-c225-4889-9050-e57271b4a5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:19:13 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Volume cd814535-49c1-487f-9e23-d6d6091b6e38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd814535-49c1-487f-9e23-d6d6091b6e38', 'volume_size': 1}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1742967054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd814535-49c1-487f-9e23-d6d6091b6e38,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='19e6ab382f9443d990609ca24b946ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:19:14Z,use_quota=True,user_id='5abf58a48fc8429a98cec3b799c317fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Creating volume cd814535-49c1-487f-9e23-d6d6091b6e38 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:19:13 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:19:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd814535-49c1-487f-9e23-d6d6091b6e38 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:19:13 devstack sudo[104109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd814535-49c1-487f-9e23-d6d6091b6e38 1073741824
Nov 05 15:19:13 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:19:14 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root
Nov 05 15:19:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd814535-49c1-487f-9e23-d6d6091b6e38 1073741824" returned: 0 in 0.413s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd814535-49c1-487f-9e23-d6d6091b6e38 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:19:14 devstack sudo[104114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd814535-49c1-487f-9e23-d6d6091b6e38
Nov 05 15:19:14 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:19:14 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root
Nov 05 15:19:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd814535-49c1-487f-9e23-d6d6091b6e38" returned: 0 in 0.244s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:19:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:19:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ebd794-c225-4889-9050-e57271b4a5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd814535-49c1-487f-9e23-d6d6091b6e38', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:19:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7337a54-847b-436b-a87a-5c143bd42411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:19:14 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Volume volume-cd814535-49c1-487f-9e23-d6d6091b6e38 (cd814535-49c1-487f-9e23-d6d6091b6e38): created successfully
Nov 05 15:19:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7337a54-847b-436b-a87a-5c143bd42411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:19:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Flow 'volume_create_manager' (b348387a-0ee0-4da8-b173-37e620aa28ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:19:14 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-cd7f09d9-ca41-45bf-9279-983e29fd34cf tempest-VolumesListTestJSON-1885868040 None] Created volume successfully.
Nov 05 15:19:15 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:19:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Flow 'volume_create_manager' (f35efd9a-192f-4e01-8224-f19655a86910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:19:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae99794-58ec-450d-93d1-921eb57d5ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:19:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae99794-58ec-450d-93d1-921eb57d5ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1413456228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e65cb8d-69e5-4690-a6ef-224306201e61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='19e6ab382f9443d990609ca24b946ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:19:15Z,use_quota=True,user_id='5abf58a48fc8429a98cec3b799c317fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:19:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eafae65d-ace0-4c2b-bbe2-d8dd1e7d5a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:19:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eafae65d-ace0-4c2b-bbe2-d8dd1e7d5a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:19:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ee27e3-5905-4288-87d3-b0b11cd4cefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:19:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ee27e3-5905-4288-87d3-b0b11cd4cefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e65cb8d-69e5-4690-a6ef-224306201e61', 'volume_name': 'volume-6e65cb8d-69e5-4690-a6ef-224306201e61', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:19:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb5ab98-8278-43fa-9b8e-9a88e2e253f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:19:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb5ab98-8278-43fa-9b8e-9a88e2e253f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:19:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc5c81f-7009-4983-be5e-52ae7a2090d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:19:15 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Volume 6e65cb8d-69e5-4690-a6ef-224306201e61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e65cb8d-69e5-4690-a6ef-224306201e61', 'volume_size': 1}
Nov 05 15:19:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:19:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:19:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1413456228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e65cb8d-69e5-4690-a6ef-224306201e61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='19e6ab382f9443d990609ca24b946ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:19:15Z,use_quota=True,user_id='5abf58a48fc8429a98cec3b799c317fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:19:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Creating volume 6e65cb8d-69e5-4690-a6ef-224306201e61 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:19:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:19:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:19:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:19:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:19:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:19:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:19:15 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:19:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6e65cb8d-69e5-4690-a6ef-224306201e61 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:19:15 devstack sudo[104118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6e65cb8d-69e5-4690-a6ef-224306201e61 1073741824
Nov 05 15:19:15 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:19:15 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root
Nov 05 15:19:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6e65cb8d-69e5-4690-a6ef-224306201e61 1073741824" returned: 0 in 0.422s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6e65cb8d-69e5-4690-a6ef-224306201e61 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:19:15 devstack sudo[104123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6e65cb8d-69e5-4690-a6ef-224306201e61
Nov 05 15:19:15 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:19:16 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root
Nov 05 15:19:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6e65cb8d-69e5-4690-a6ef-224306201e61" returned: 0 in 0.255s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:19:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:19:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc5c81f-7009-4983-be5e-52ae7a2090d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e65cb8d-69e5-4690-a6ef-224306201e61', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:19:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503d11fd-2ee9-43a5-bfd9-24a8c4733667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:19:16 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Volume volume-6e65cb8d-69e5-4690-a6ef-224306201e61 (6e65cb8d-69e5-4690-a6ef-224306201e61): created successfully
Nov 05 15:19:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503d11fd-2ee9-43a5-bfd9-24a8c4733667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:19:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Flow 'volume_create_manager' (f35efd9a-192f-4e01-8224-f19655a86910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:19:16 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0dd6991f-0e09-438f-98d7-77dff5c9d4b0 tempest-VolumesListTestJSON-1885868040 None] Created volume successfully.
Nov 05 15:19:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f780c307-b124-4ab1-9a35-2a0c55516462 tempest-VolumesListTestJSON-1885868040 None] Acquiring lock "cinder-6e65cb8d-69e5-4690-a6ef-224306201e61-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:19:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f780c307-b124-4ab1-9a35-2a0c55516462 tempest-VolumesListTestJSON-1885868040 None] Lock "cinder-6e65cb8d-69e5-4690-a6ef-224306201e61-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:19:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f780c307-b124-4ab1-9a35-2a0c55516462 tempest-VolumesListTestJSON-1885868040 None] Acquiring lock "cinder-quobyte-6e65cb8d-69e5-4690-a6ef-224306201e61" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:19:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f780c307-b124-4ab1-9a35-2a0c55516462 tempest-VolumesListTestJSON-1885868040 None] Lock "cinder-quobyte-6e65cb8d-69e5-4690-a6ef-224306201e61" acquired by "delete_volume" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:19:18 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25b1d0f-d912-4279-9c7f-79e40d546d24]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:19:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f780c307-b124-4ab1-9a35-2a0c55516462 tempest-VolumesListTestJSON-1885868040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6e65cb8d-69e5-4690-a6ef-224306201e61 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:19:18 devstack sudo[104128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6e65cb8d-69e5-4690-a6ef-224306201e61
Nov 05 15:19:18 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:19:19 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root
Nov 05 15:19:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f780c307-b124-4ab1-9a35-2a0c55516462 tempest-VolumesListTestJSON-1885868040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6e65cb8d-69e5-4690-a6ef-224306201e61" returned: 0 in 0.446s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f780c307-b124-4ab1-9a35-2a0c55516462 tempest-VolumesListTestJSON-1885868040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6e65cb8d-69e5-4690-a6ef-224306201e61 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:19:19 devstack sudo[104136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6e65cb8d-69e5-4690-a6ef-224306201e61
Nov 05 15:19:19 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:19:19 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root
Nov 05 15:19:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f780c307-b124-4ab1-9a35-2a0c55516462 tempest-VolumesListTestJSON-1885868040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6e65cb8d-69e5-4690-a6ef-224306201e61" returned: 0 in 0.297s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f780c307-b124-4ab1-9a35-2a0c55516462 tempest-VolumesListTestJSON-1885868040 None] Lock "cinder-quobyte-6e65cb8d-69e5-4690-a6ef-224306201e61" released by "delete_volume" :: held 0.792s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:19:19 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-f780c307-b124-4ab1-9a35-2a0c55516462 tempest-VolumesListTestJSON-1885868040 None] Created reservations ['c258e8e9-ff40-42dc-abd2-f04df4917e0b', '77ac6168-281d-4b17-a37d-ab2176ae0415', 'e7cca6c4-a045-425a-b40a-06f3e5c49dc5', '9dd5ddfa-26c5-494b-a9fe-1572be8db272'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:19:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f780c307-b124-4ab1-9a35-2a0c55516462 tempest-VolumesListTestJSON-1885868040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:19:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f780c307-b124-4ab1-9a35-2a0c55516462 tempest-VolumesListTestJSON-1885868040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:19:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f780c307-b124-4ab1-9a35-2a0c55516462 tempest-VolumesListTestJSON-1885868040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:19:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f780c307-b124-4ab1-9a35-2a0c55516462 tempest-VolumesListTestJSON-1885868040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:19:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f780c307-b124-4ab1-9a35-2a0c55516462 tempest-VolumesListTestJSON-1885868040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:19:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f780c307-b124-4ab1-9a35-2a0c55516462 tempest-VolumesListTestJSON-1885868040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:19:19 devstack sudo[104141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:19:19 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:19:19 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root
Nov 05 15:19:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f780c307-b124-4ab1-9a35-2a0c55516462 tempest-VolumesListTestJSON-1885868040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.260s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:19 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-f780c307-b124-4ab1-9a35-2a0c55516462 tempest-VolumesListTestJSON-1885868040 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:19:19 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f780c307-b124-4ab1-9a35-2a0c55516462 tempest-VolumesListTestJSON-1885868040 None] Deleted volume successfully.
Nov 05 15:19:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d7dce383-f09b-433c-896d-7a0b7944cb59 tempest-VolumesListTestJSON-1885868040 None] Acquiring lock "cinder-cd814535-49c1-487f-9e23-d6d6091b6e38-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:19:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f780c307-b124-4ab1-9a35-2a0c55516462 tempest-VolumesListTestJSON-1885868040 None] Lock "cinder-6e65cb8d-69e5-4690-a6ef-224306201e61-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:19:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d7dce383-f09b-433c-896d-7a0b7944cb59 tempest-VolumesListTestJSON-1885868040 None] Lock "cinder-cd814535-49c1-487f-9e23-d6d6091b6e38-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:19:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d7dce383-f09b-433c-896d-7a0b7944cb59 tempest-VolumesListTestJSON-1885868040 None] Acquiring lock "cinder-quobyte-cd814535-49c1-487f-9e23-d6d6091b6e38" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:19:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d7dce383-f09b-433c-896d-7a0b7944cb59 tempest-VolumesListTestJSON-1885868040 None] Lock "cinder-quobyte-cd814535-49c1-487f-9e23-d6d6091b6e38" acquired by "delete_volume" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:19:19 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7e51cc-5704-41d4-8d86-9c6a6df133f5]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:19:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d7dce383-f09b-433c-896d-7a0b7944cb59 tempest-VolumesListTestJSON-1885868040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd814535-49c1-487f-9e23-d6d6091b6e38 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:19:20 devstack sudo[104144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd814535-49c1-487f-9e23-d6d6091b6e38
Nov 05 15:19:20 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:19:20 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root
Nov 05 15:19:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d7dce383-f09b-433c-896d-7a0b7944cb59 tempest-VolumesListTestJSON-1885868040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd814535-49c1-487f-9e23-d6d6091b6e38" returned: 0 in 0.399s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d7dce383-f09b-433c-896d-7a0b7944cb59 tempest-VolumesListTestJSON-1885868040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd814535-49c1-487f-9e23-d6d6091b6e38 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:19:20 devstack sudo[104160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd814535-49c1-487f-9e23-d6d6091b6e38
Nov 05 15:19:20 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:19:20 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root
Nov 05 15:19:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d7dce383-f09b-433c-896d-7a0b7944cb59 tempest-VolumesListTestJSON-1885868040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd814535-49c1-487f-9e23-d6d6091b6e38" returned: 0 in 0.243s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d7dce383-f09b-433c-896d-7a0b7944cb59 tempest-VolumesListTestJSON-1885868040 None] Lock "cinder-quobyte-cd814535-49c1-487f-9e23-d6d6091b6e38" released by "delete_volume" :: held 0.702s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:19:20 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-d7dce383-f09b-433c-896d-7a0b7944cb59 tempest-VolumesListTestJSON-1885868040 None] Created reservations ['7e793b14-ed99-40c2-a775-5b2f5be5f623', '6e2bae9c-f80b-4158-8485-41d69d9edd96', '17ab4c61-8de3-49ef-8dba-7ad3d98bd9cc', 'c0b63582-9492-4e35-bf17-23b61bda3ae7'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:19:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d7dce383-f09b-433c-896d-7a0b7944cb59 tempest-VolumesListTestJSON-1885868040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:19:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d7dce383-f09b-433c-896d-7a0b7944cb59 tempest-VolumesListTestJSON-1885868040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:19:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d7dce383-f09b-433c-896d-7a0b7944cb59 tempest-VolumesListTestJSON-1885868040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:19:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d7dce383-f09b-433c-896d-7a0b7944cb59 tempest-VolumesListTestJSON-1885868040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:19:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d7dce383-f09b-433c-896d-7a0b7944cb59 tempest-VolumesListTestJSON-1885868040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:19:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d7dce383-f09b-433c-896d-7a0b7944cb59 tempest-VolumesListTestJSON-1885868040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:19:20 devstack sudo[104163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:19:20 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:19:20 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root
Nov 05 15:19:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d7dce383-f09b-433c-896d-7a0b7944cb59 tempest-VolumesListTestJSON-1885868040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.246s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:21 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-d7dce383-f09b-433c-896d-7a0b7944cb59 tempest-VolumesListTestJSON-1885868040 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:19:21 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d7dce383-f09b-433c-896d-7a0b7944cb59 tempest-VolumesListTestJSON-1885868040 None] Deleted volume successfully.
Nov 05 15:19:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d7dce383-f09b-433c-896d-7a0b7944cb59 tempest-VolumesListTestJSON-1885868040 None] Lock "cinder-cd814535-49c1-487f-9e23-d6d6091b6e38-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:19:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5751ec23-5395-4023-99c3-d63aac6335af tempest-VolumesListTestJSON-1885868040 None] Acquiring lock "cinder-13506cdc-f399-418e-8fee-eeee8991feba-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:19:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5751ec23-5395-4023-99c3-d63aac6335af tempest-VolumesListTestJSON-1885868040 None] Lock "cinder-13506cdc-f399-418e-8fee-eeee8991feba-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:19:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5751ec23-5395-4023-99c3-d63aac6335af tempest-VolumesListTestJSON-1885868040 None] Acquiring lock "cinder-quobyte-13506cdc-f399-418e-8fee-eeee8991feba" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:19:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5751ec23-5395-4023-99c3-d63aac6335af tempest-VolumesListTestJSON-1885868040 None] Lock "cinder-quobyte-13506cdc-f399-418e-8fee-eeee8991feba" acquired by "delete_volume" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:19:21 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb01978c-d62e-4244-8f32-da58aae893bd]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:19:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5751ec23-5395-4023-99c3-d63aac6335af tempest-VolumesListTestJSON-1885868040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-13506cdc-f399-418e-8fee-eeee8991feba {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:19:21 devstack sudo[104172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-13506cdc-f399-418e-8fee-eeee8991feba
Nov 05 15:19:21 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:19:21 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root
Nov 05 15:19:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5751ec23-5395-4023-99c3-d63aac6335af tempest-VolumesListTestJSON-1885868040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-13506cdc-f399-418e-8fee-eeee8991feba" returned: 0 in 0.346s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5751ec23-5395-4023-99c3-d63aac6335af tempest-VolumesListTestJSON-1885868040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-13506cdc-f399-418e-8fee-eeee8991feba {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:19:21 devstack sudo[104177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-13506cdc-f399-418e-8fee-eeee8991feba
Nov 05 15:19:21 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:19:21 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root
Nov 05 15:19:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5751ec23-5395-4023-99c3-d63aac6335af tempest-VolumesListTestJSON-1885868040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-13506cdc-f399-418e-8fee-eeee8991feba" returned: 0 in 0.254s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5751ec23-5395-4023-99c3-d63aac6335af tempest-VolumesListTestJSON-1885868040 None] Lock "cinder-quobyte-13506cdc-f399-418e-8fee-eeee8991feba" released by "delete_volume" :: held 0.643s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:19:21 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-5751ec23-5395-4023-99c3-d63aac6335af tempest-VolumesListTestJSON-1885868040 None] Created reservations ['3af59325-205f-434c-ae06-7b01ef61fcec', '2b2fe801-4ee4-4596-8eee-b9ea1d9f258d', 'b7e4a20a-420f-413f-919b-ea2fd56887c2', '5cc59fd0-b01a-49c9-805d-730611d221e6'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:19:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5751ec23-5395-4023-99c3-d63aac6335af tempest-VolumesListTestJSON-1885868040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:19:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5751ec23-5395-4023-99c3-d63aac6335af tempest-VolumesListTestJSON-1885868040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:19:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5751ec23-5395-4023-99c3-d63aac6335af tempest-VolumesListTestJSON-1885868040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:19:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5751ec23-5395-4023-99c3-d63aac6335af tempest-VolumesListTestJSON-1885868040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:19:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5751ec23-5395-4023-99c3-d63aac6335af tempest-VolumesListTestJSON-1885868040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:19:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5751ec23-5395-4023-99c3-d63aac6335af tempest-VolumesListTestJSON-1885868040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:19:21 devstack sudo[104180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:19:21 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:19:22 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root
Nov 05 15:19:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5751ec23-5395-4023-99c3-d63aac6335af tempest-VolumesListTestJSON-1885868040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.249s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:22 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-5751ec23-5395-4023-99c3-d63aac6335af tempest-VolumesListTestJSON-1885868040 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:19:22 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5751ec23-5395-4023-99c3-d63aac6335af tempest-VolumesListTestJSON-1885868040 None] Deleted volume successfully.
Nov 05 15:19:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5751ec23-5395-4023-99c3-d63aac6335af tempest-VolumesListTestJSON-1885868040 None] Lock "cinder-13506cdc-f399-418e-8fee-eeee8991feba-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Flow 'volume_create_manager' (6d8a83ed-90d7-4f35-8e4c-47db9188fc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a88c99d-00a7-441a-8261-c2d75a330a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a88c99d-00a7-441a-8261-c2d75a330a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-141891783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77cee26-102b-4409-84e3-6e75103397c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2786733df6494f82be6860cad17caeb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:19:26Z,use_quota=True,user_id='849bdf156dc94105928bc14bf04de842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c7883f-2182-4afc-8fc7-ccb304468aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c7883f-2182-4afc-8fc7-ccb304468aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7dff69d-dd35-49e2-ac35-f8e55b4e9d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7dff69d-dd35-49e2-ac35-f8e55b4e9d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd77cee26-102b-4409-84e3-6e75103397c9', 'volume_name': 'volume-d77cee26-102b-4409-84e3-6e75103397c9', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e51f8c9-ba4f-48ef-90e8-eecaa62cfc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e51f8c9-ba4f-48ef-90e8-eecaa62cfc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615d83aa-c4b1-424e-ace5-1ba04a4b5aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:19:25 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Volume d77cee26-102b-4409-84e3-6e75103397c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d77cee26-102b-4409-84e3-6e75103397c9', 'volume_size': 1}
Nov 05 15:19:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:19:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-141891783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77cee26-102b-4409-84e3-6e75103397c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2786733df6494f82be6860cad17caeb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:19:26Z,use_quota=True,user_id='849bdf156dc94105928bc14bf04de842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Creating volume d77cee26-102b-4409-84e3-6e75103397c9 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:19:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:19:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:19:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:19:25 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:19:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d77cee26-102b-4409-84e3-6e75103397c9 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:19:25 devstack sudo[104243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d77cee26-102b-4409-84e3-6e75103397c9 1073741824
Nov 05 15:19:25 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:19:26 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root
Nov 05 15:19:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d77cee26-102b-4409-84e3-6e75103397c9 1073741824" returned: 0 in 0.418s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d77cee26-102b-4409-84e3-6e75103397c9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:19:26 devstack sudo[104249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d77cee26-102b-4409-84e3-6e75103397c9
Nov 05 15:19:26 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:19:26 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root
Nov 05 15:19:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d77cee26-102b-4409-84e3-6e75103397c9" returned: 0 in 0.240s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:19:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:19:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615d83aa-c4b1-424e-ace5-1ba04a4b5aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d77cee26-102b-4409-84e3-6e75103397c9', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:19:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2901f3a-2b50-405a-a746-78f382b99e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:19:26 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Volume volume-d77cee26-102b-4409-84e3-6e75103397c9 (d77cee26-102b-4409-84e3-6e75103397c9): created successfully
Nov 05 15:19:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2901f3a-2b50-405a-a746-78f382b99e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:19:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Flow 'volume_create_manager' (6d8a83ed-90d7-4f35-8e4c-47db9188fc26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:19:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-58e3d232-cb3e-4af4-88b4-f7e9ecc1593d tempest-VolumesNegativeTest-612160061 None] Created volume successfully.
Nov 05 15:19:33 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-9b5295ee-d5e7-4d64-a409-287a7d12bf72 req-a0459552-7e38-434e-af3b-85e659647cd4 tempest-TestShelveInstance-392259644 None] Terminate volume connection completed successfully.
Nov 05 15:19:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-9b5295ee-d5e7-4d64-a409-287a7d12bf72 req-a0459552-7e38-434e-af3b-85e659647cd4 tempest-TestShelveInstance-392259644 None] Deleting attachment c7c7d0bc-6f6f-4cb0-973a-981710b6ebb2. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 15:19:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-4e6a1a16-5db5-4982-86a2-eeb8da96413f req-d112cd76-8f9f-4da8-beac-35fdb248fdee tempest-TestShelveInstance-392259644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:19:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-4e6a1a16-5db5-4982-86a2-eeb8da96413f req-d112cd76-8f9f-4da8-beac-35fdb248fdee tempest-TestShelveInstance-392259644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:19:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-4e6a1a16-5db5-4982-86a2-eeb8da96413f req-d112cd76-8f9f-4da8-beac-35fdb248fdee tempest-TestShelveInstance-392259644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:19:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-4e6a1a16-5db5-4982-86a2-eeb8da96413f req-d112cd76-8f9f-4da8-beac-35fdb248fdee tempest-TestShelveInstance-392259644 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628', 'name': 'volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c3269b1d-0871-490e-bef0-f2ff81c6630d', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 15:19:36 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-4e6a1a16-5db5-4982-86a2-eeb8da96413f req-d112cd76-8f9f-4da8-beac-35fdb248fdee tempest-TestShelveInstance-392259644 None] attachment_update completed successfully.
Nov 05 15:19:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:19:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:19:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:19:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:19:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:19:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:19:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:19:37 devstack sudo[104415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:19:37 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:19:37 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root
Nov 05 15:19:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.327s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:19:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:19:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 15:19:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread info: [<_MainThread(MainThread, started 136317437956224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136317326340928)>, <Thread(Thread-3 (stat_writer), started daemon 136317326487936)>, <Thread(Rabbit-heartbeat, started daemon 136317321464000)>, <Thread(Thread-5 (_runner), started daemon 136317321550592)>, <Thread(Thread-7 (_runner), started daemon 136317321658496)>, <Thread(fd_logger, started daemon 136317319612992)>, <Thread(privsep_reader, started daemon 136317319622400)>, <Thread(tpool_thread_0, started daemon 136317310928576)>, <Thread(tpool_thread_1, started daemon 136317302535872)>, <Thread(tpool_thread_2, started daemon 136317294143168)>, <Thread(tpool_thread_3, started daemon 136317285750464)>, <Thread(tpool_thread_4, started daemon 136317277357760)>, <Thread(tpool_thread_5, started daemon 136317268965056)>, <Thread(tpool_thread_6, started daemon 136317260572352)>, <Thread(tpool_thread_7, started daemon 136317252179648)>, <Thread(tpool_thread_8, started daemon 136317243786944)>, <Thread(tpool_thread_9, started daemon 136317235394240)>, <Thread(tpool_thread_10, started daemon 136317227001536)>, <Thread(tpool_thread_11, started daemon 136317218608832)>, <Thread(tpool_thread_12, started daemon 136317210216128)>, <Thread(tpool_thread_13, started daemon 136317201807040)>, <Thread(tpool_thread_14, started daemon 136317193397952)>, <Thread(tpool_thread_15, started daemon 136317184988864)>, <Thread(tpool_thread_16, started daemon 136317176579776)>, <Thread(tpool_thread_17, started daemon 136317168170688)>, <Thread(tpool_thread_18, started daemon 136317159761600)>, <Thread(tpool_thread_19, started daemon 136317151352512)>] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 15:19:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8bbb7e3b-b47e-42e1-8ae6-3556a22814a6 tempest-VolumesNegativeTest-612160061 None] Acquiring lock "cinder-d77cee26-102b-4409-84e3-6e75103397c9-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:19:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8bbb7e3b-b47e-42e1-8ae6-3556a22814a6 tempest-VolumesNegativeTest-612160061 None] Lock "cinder-d77cee26-102b-4409-84e3-6e75103397c9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:19:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8bbb7e3b-b47e-42e1-8ae6-3556a22814a6 tempest-VolumesNegativeTest-612160061 None] Acquiring lock "cinder-quobyte-d77cee26-102b-4409-84e3-6e75103397c9" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:19:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8bbb7e3b-b47e-42e1-8ae6-3556a22814a6 tempest-VolumesNegativeTest-612160061 None] Lock "cinder-quobyte-d77cee26-102b-4409-84e3-6e75103397c9" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:19:45 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b13dd3-2e69-4b17-aefa-1529e76216e7]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:19:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8bbb7e3b-b47e-42e1-8ae6-3556a22814a6 tempest-VolumesNegativeTest-612160061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d77cee26-102b-4409-84e3-6e75103397c9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:19:45 devstack sudo[104895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d77cee26-102b-4409-84e3-6e75103397c9
Nov 05 15:19:45 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:19:45 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root
Nov 05 15:19:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8bbb7e3b-b47e-42e1-8ae6-3556a22814a6 tempest-VolumesNegativeTest-612160061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d77cee26-102b-4409-84e3-6e75103397c9" returned: 0 in 0.421s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8bbb7e3b-b47e-42e1-8ae6-3556a22814a6 tempest-VolumesNegativeTest-612160061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d77cee26-102b-4409-84e3-6e75103397c9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:19:45 devstack sudo[104900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d77cee26-102b-4409-84e3-6e75103397c9
Nov 05 15:19:45 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:19:46 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root
Nov 05 15:19:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8bbb7e3b-b47e-42e1-8ae6-3556a22814a6 tempest-VolumesNegativeTest-612160061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d77cee26-102b-4409-84e3-6e75103397c9" returned: 0 in 0.263s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8bbb7e3b-b47e-42e1-8ae6-3556a22814a6 tempest-VolumesNegativeTest-612160061 None] Lock "cinder-quobyte-d77cee26-102b-4409-84e3-6e75103397c9" released by "delete_volume" :: held 0.734s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:19:46 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=54,cinder:UPDATE=49,cinder:INSERT=20,cinder:DELETE=4 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:19:46 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=56,cinder:SELECT=54,cinder:INSERT=13,cinder:DELETE=5 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:19:46 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-8bbb7e3b-b47e-42e1-8ae6-3556a22814a6 tempest-VolumesNegativeTest-612160061 None] Created reservations ['9116cd2b-3379-47f2-9cd1-3d0a88f611ab', '3bf3b616-3644-426e-bab6-cc9472d597f0', '0164154c-2caa-46d3-9243-31a16fefdeb3', '66b87e47-5a68-42e6-8752-29d3006e554a'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:19:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8bbb7e3b-b47e-42e1-8ae6-3556a22814a6 tempest-VolumesNegativeTest-612160061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:19:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8bbb7e3b-b47e-42e1-8ae6-3556a22814a6 tempest-VolumesNegativeTest-612160061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:19:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8bbb7e3b-b47e-42e1-8ae6-3556a22814a6 tempest-VolumesNegativeTest-612160061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:19:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8bbb7e3b-b47e-42e1-8ae6-3556a22814a6 tempest-VolumesNegativeTest-612160061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:19:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8bbb7e3b-b47e-42e1-8ae6-3556a22814a6 tempest-VolumesNegativeTest-612160061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:19:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8bbb7e3b-b47e-42e1-8ae6-3556a22814a6 tempest-VolumesNegativeTest-612160061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:19:46 devstack sudo[104903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:19:46 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:19:46 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root
Nov 05 15:19:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8bbb7e3b-b47e-42e1-8ae6-3556a22814a6 tempest-VolumesNegativeTest-612160061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.260s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:19:46 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-8bbb7e3b-b47e-42e1-8ae6-3556a22814a6 tempest-VolumesNegativeTest-612160061 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:19:46 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-8bbb7e3b-b47e-42e1-8ae6-3556a22814a6 tempest-VolumesNegativeTest-612160061 None] Deleted volume successfully.
Nov 05 15:19:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8bbb7e3b-b47e-42e1-8ae6-3556a22814a6 tempest-VolumesNegativeTest-612160061 None] Lock "cinder-d77cee26-102b-4409-84e3-6e75103397c9-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:19:56 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:INSERT=2,cinder:UPDATE=7,cinder:SELECT=3 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:19:56 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=3,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:20:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-826f3576-2677-4a74-88fa-72f65f1a1eae req-3ab35245-a3db-49ce-8717-b8609ed4169d tempest-TestShelveInstance-392259644 None] Terminate volume connection completed successfully.
Nov 05 15:20:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-826f3576-2677-4a74-88fa-72f65f1a1eae req-3ab35245-a3db-49ce-8717-b8609ed4169d tempest-TestShelveInstance-392259644 None] Deleting attachment c3269b1d-0871-490e-bef0-f2ff81c6630d. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 15:20:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-826f3576-2677-4a74-88fa-72f65f1a1eae req-0cac30a1-71f6-4275-a916-84ea660042d9 tempest-TestShelveInstance-392259644 None] Acquiring lock "cinder-14023c80-0f92-4f5a-90fa-8a5d3072df2d-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-826f3576-2677-4a74-88fa-72f65f1a1eae req-0cac30a1-71f6-4275-a916-84ea660042d9 tempest-TestShelveInstance-392259644 None] Lock "cinder-14023c80-0f92-4f5a-90fa-8a5d3072df2d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-826f3576-2677-4a74-88fa-72f65f1a1eae req-0cac30a1-71f6-4275-a916-84ea660042d9 tempest-TestShelveInstance-392259644 None] Acquiring lock "cinder-quobyte-14023c80-0f92-4f5a-90fa-8a5d3072df2d" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-826f3576-2677-4a74-88fa-72f65f1a1eae req-0cac30a1-71f6-4275-a916-84ea660042d9 tempest-TestShelveInstance-392259644 None] Lock "cinder-quobyte-14023c80-0f92-4f5a-90fa-8a5d3072df2d" acquired by "delete_volume" :: waited 0.044s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:06 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a11161-c2dd-4a93-8858-5efd027036df]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:20:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-826f3576-2677-4a74-88fa-72f65f1a1eae req-0cac30a1-71f6-4275-a916-84ea660042d9 tempest-TestShelveInstance-392259644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:06 devstack sudo[104980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d
Nov 05 15:20:06 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:07 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-826f3576-2677-4a74-88fa-72f65f1a1eae req-0cac30a1-71f6-4275-a916-84ea660042d9 tempest-TestShelveInstance-392259644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d" returned: 0 in 0.461s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-826f3576-2677-4a74-88fa-72f65f1a1eae req-0cac30a1-71f6-4275-a916-84ea660042d9 tempest-TestShelveInstance-392259644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:07 devstack sudo[104985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d
Nov 05 15:20:07 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:07 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-826f3576-2677-4a74-88fa-72f65f1a1eae req-0cac30a1-71f6-4275-a916-84ea660042d9 tempest-TestShelveInstance-392259644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-14023c80-0f92-4f5a-90fa-8a5d3072df2d" returned: 0 in 0.244s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-826f3576-2677-4a74-88fa-72f65f1a1eae req-0cac30a1-71f6-4275-a916-84ea660042d9 tempest-TestShelveInstance-392259644 None] Lock "cinder-quobyte-14023c80-0f92-4f5a-90fa-8a5d3072df2d" released by "delete_volume" :: held 0.773s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:07 devstack cinder-volume[87150]: DEBUG cinder.quota [req-826f3576-2677-4a74-88fa-72f65f1a1eae req-0cac30a1-71f6-4275-a916-84ea660042d9 tempest-TestShelveInstance-392259644 None] Created reservations ['dcfd17e6-ac5b-42c0-9500-603ed82cd8f7', '9dca98a8-3a64-4d14-96c9-4adf38f188e4', '6c55b3d5-906a-45d9-8738-bca13ac66d3b', '646431c3-00e9-47fb-bfc5-41b49fa8c4e5'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:20:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-826f3576-2677-4a74-88fa-72f65f1a1eae req-0cac30a1-71f6-4275-a916-84ea660042d9 tempest-TestShelveInstance-392259644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-826f3576-2677-4a74-88fa-72f65f1a1eae req-0cac30a1-71f6-4275-a916-84ea660042d9 tempest-TestShelveInstance-392259644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-826f3576-2677-4a74-88fa-72f65f1a1eae req-0cac30a1-71f6-4275-a916-84ea660042d9 tempest-TestShelveInstance-392259644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-826f3576-2677-4a74-88fa-72f65f1a1eae req-0cac30a1-71f6-4275-a916-84ea660042d9 tempest-TestShelveInstance-392259644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-826f3576-2677-4a74-88fa-72f65f1a1eae req-0cac30a1-71f6-4275-a916-84ea660042d9 tempest-TestShelveInstance-392259644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-826f3576-2677-4a74-88fa-72f65f1a1eae req-0cac30a1-71f6-4275-a916-84ea660042d9 tempest-TestShelveInstance-392259644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:07 devstack sudo[104988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:20:07 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:07 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-826f3576-2677-4a74-88fa-72f65f1a1eae req-0cac30a1-71f6-4275-a916-84ea660042d9 tempest-TestShelveInstance-392259644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.263s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:07 devstack cinder-volume[87150]: DEBUG cinder.manager [req-826f3576-2677-4a74-88fa-72f65f1a1eae req-0cac30a1-71f6-4275-a916-84ea660042d9 tempest-TestShelveInstance-392259644 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:20:07 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-826f3576-2677-4a74-88fa-72f65f1a1eae req-0cac30a1-71f6-4275-a916-84ea660042d9 tempest-TestShelveInstance-392259644 None] Deleted volume successfully.
Nov 05 15:20:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-826f3576-2677-4a74-88fa-72f65f1a1eae req-0cac30a1-71f6-4275-a916-84ea660042d9 tempest-TestShelveInstance-392259644 None] Lock "cinder-14023c80-0f92-4f5a-90fa-8a5d3072df2d-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:17 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=6,cinder:UPDATE=6,cinder:INSERT=2 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:20:17 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:20:21 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:20:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Flow 'volume_create_manager' (e11b0277-6634-45be-9454-8379b9e919f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:20:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a99819a-82ea-4e84-9da3-87d293f2a635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a99819a-82ea-4e84-9da3-87d293f2a635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1371727304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=721662e8-36ca-403c-a568-29e4d0333028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18b2b52be174553ac8eb15e889fc93d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:22Z,use_quota=True,user_id='e6029f8a2a5e40eba4972f2d9dcf72b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a69afdd-fa03-4067-a806-77f831ff0f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a69afdd-fa03-4067-a806-77f831ff0f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941a8c75-259c-4409-96dd-9342bb7566fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941a8c75-259c-4409-96dd-9342bb7566fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '721662e8-36ca-403c-a568-29e4d0333028', 'volume_name': 'volume-721662e8-36ca-403c-a568-29e4d0333028', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a56e2cd-b6c5-4d73-8381-75060d235f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a56e2cd-b6c5-4d73-8381-75060d235f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bfaa1cc-522e-45c6-ba6a-19c97ded940f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:21 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Volume 721662e8-36ca-403c-a568-29e4d0333028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-721662e8-36ca-403c-a568-29e4d0333028', 'volume_size': 1}
Nov 05 15:20:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1371727304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=721662e8-36ca-403c-a568-29e4d0333028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18b2b52be174553ac8eb15e889fc93d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:22Z,use_quota=True,user_id='e6029f8a2a5e40eba4972f2d9dcf72b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:20:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Creating volume 721662e8-36ca-403c-a568-29e4d0333028 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:20:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:20:21 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:20:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-721662e8-36ca-403c-a568-29e4d0333028 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:21 devstack sudo[105112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-721662e8-36ca-403c-a568-29e4d0333028 1073741824
Nov 05 15:20:21 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:22 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:20:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Flow 'volume_create_manager' (6ba97045-deaa-4191-baf0-193a8956f1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:20:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8686e6a7-14b9-4f4c-b228-b98e6529f4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8686e6a7-14b9-4f4c-b228-b98e6529f4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1206624696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18b2b52be174553ac8eb15e889fc93d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:22Z,use_quota=True,user_id='e6029f8a2a5e40eba4972f2d9dcf72b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c59cc92-19c2-4b5b-883b-1dae66bc8d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c59cc92-19c2-4b5b-883b-1dae66bc8d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f93c62-0abb-4b2a-88d9-957695762604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f93c62-0abb-4b2a-88d9-957695762604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e', 'volume_name': 'volume-2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e334881-c2c8-4830-b480-0f6082debb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e334881-c2c8-4830-b480-0f6082debb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa820b39-42e3-4e48-a008-15b98a50d3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:22 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Volume 2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e', 'volume_size': 1}
Nov 05 15:20:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:22 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-721662e8-36ca-403c-a568-29e4d0333028 1073741824" returned: 0 in 0.905s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-721662e8-36ca-403c-a568-29e4d0333028 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:22 devstack sudo[105118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-721662e8-36ca-403c-a568-29e4d0333028
Nov 05 15:20:22 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:23 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-721662e8-36ca-403c-a568-29e4d0333028" returned: 0 in 0.358s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.833s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1206624696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18b2b52be174553ac8eb15e889fc93d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:22Z,use_quota=True,user_id='e6029f8a2a5e40eba4972f2d9dcf72b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Creating volume 2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:20:23 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bfaa1cc-522e-45c6-ba6a-19c97ded940f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-721662e8-36ca-403c-a568-29e4d0333028', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:23 devstack sudo[105121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e 1073741824
Nov 05 15:20:23 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c609bc-33ee-4f4d-8ad1-bd36129c6620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:23 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Volume volume-721662e8-36ca-403c-a568-29e4d0333028 (721662e8-36ca-403c-a568-29e4d0333028): created successfully
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c609bc-33ee-4f4d-8ad1-bd36129c6620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Flow 'volume_create_manager' (e11b0277-6634-45be-9454-8379b9e919f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Flow 'volume_create_manager' (15ba037e-b7b7-46ad-9e10-5659d5af3011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f8c3f2-91a8-4206-9985-479e6abef449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:23 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2cea7116-152c-4885-8a3d-515f5fa8178c tempest-CreateVolumesFromImageTest-442341105 None] Created volume successfully.
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f8c3f2-91a8-4206-9985-479e6abef449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-550343372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18b2b52be174553ac8eb15e889fc93d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:23Z,use_quota=True,user_id='e6029f8a2a5e40eba4972f2d9dcf72b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21942691-e169-413b-a054-6e2f553090b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21942691-e169-413b-a054-6e2f553090b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f07a977e-8059-415b-b678-c19b7e619773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f07a977e-8059-415b-b678-c19b7e619773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d', 'volume_name': 'volume-d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2dd907-f61e-4a96-89a8-484df1a698fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2dd907-f61e-4a96-89a8-484df1a698fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (631f9ad5-f13f-4405-a1fb-e353be01157c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:23 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Volume d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d', 'volume_size': 1}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Flow 'volume_create_manager' (c04aa88c-78e9-4fbf-8876-455708fa5b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ae44bd-ff83-484e-b7ab-548eb388b600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ae44bd-ff83-484e-b7ab-548eb388b600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-606943803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7faa15-1574-44dc-b59b-3dbe68d18608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18b2b52be174553ac8eb15e889fc93d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:24Z,use_quota=True,user_id='e6029f8a2a5e40eba4972f2d9dcf72b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7523766c-e284-4264-a8a1-5ad7b82aa94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7523766c-e284-4264-a8a1-5ad7b82aa94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee6718bf-68de-4364-b9b5-6636ecdb1fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee6718bf-68de-4364-b9b5-6636ecdb1fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea7faa15-1574-44dc-b59b-3dbe68d18608', 'volume_name': 'volume-ea7faa15-1574-44dc-b59b-3dbe68d18608', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a264dd8c-2f79-4fd9-8a0c-9229b3d49a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a264dd8c-2f79-4fd9-8a0c-9229b3d49a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65acf779-eb1a-47d8-93b2-f9defc3f9e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:23 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Volume ea7faa15-1574-44dc-b59b-3dbe68d18608: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea7faa15-1574-44dc-b59b-3dbe68d18608', 'volume_size': 1}
Nov 05 15:20:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Flow 'volume_create_manager' (e1418f7e-f628-40b9-aa4c-00d040d63eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b0fc6c-9cbc-4e36-89b6-d387eca1622d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b0fc6c-9cbc-4e36-89b6-d387eca1622d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-923152587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605aca44-c4f6-43ec-a4fe-ad0cbae00b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fdc89289fad492eaad240e77e7462f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:24Z,use_quota=True,user_id='b8ccb728c73f47e2b380c3f7846d27c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5dbe32-7723-41e0-8860-ab7a88085f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5dbe32-7723-41e0-8860-ab7a88085f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa1c19f-14c0-47c5-9d2c-a2e994a69c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa1c19f-14c0-47c5-9d2c-a2e994a69c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '605aca44-c4f6-43ec-a4fe-ad0cbae00b9b', 'volume_name': 'volume-605aca44-c4f6-43ec-a4fe-ad0cbae00b9b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1499a7b-ec92-4dc3-92eb-fc7546ea3c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1499a7b-ec92-4dc3-92eb-fc7546ea3c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484db9ed-1406-496e-9162-87b18cc2146e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:24 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Volume 605aca44-c4f6-43ec-a4fe-ad0cbae00b9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-605aca44-c4f6-43ec-a4fe-ad0cbae00b9b', 'volume_size': 1}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:24 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e 1073741824" returned: 0 in 1.147s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:24 devstack sudo[105162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e
Nov 05 15:20:24 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Flow 'volume_create_manager' (01f39bb4-f8d9-4778-9481-f46195f51e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd6fc00-c313-40b8-b3fd-b277f2d9b3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd6fc00-c313-40b8-b3fd-b277f2d9b3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-495924194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17396b3b-8065-41f3-ba18-e430e713d88c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18b2b52be174553ac8eb15e889fc93d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:24Z,use_quota=True,user_id='e6029f8a2a5e40eba4972f2d9dcf72b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04731f2e-f9f7-4ae1-aea9-bc8ad1897f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04731f2e-f9f7-4ae1-aea9-bc8ad1897f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c609c4-b62c-44ed-b058-e626d432e33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c609c4-b62c-44ed-b058-e626d432e33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17396b3b-8065-41f3-ba18-e430e713d88c', 'volume_name': 'volume-17396b3b-8065-41f3-ba18-e430e713d88c', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64dc1da7-ebc2-44ad-9325-67fa07026844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64dc1da7-ebc2-44ad-9325-67fa07026844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b757c58-30b9-4511-a338-0caf4daff6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:24 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Volume 17396b3b-8065-41f3-ba18-e430e713d88c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17396b3b-8065-41f3-ba18-e430e713d88c', 'volume_size': 1}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:24 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e" returned: 0 in 0.276s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.191s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-550343372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18b2b52be174553ac8eb15e889fc93d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:23Z,use_quota=True,user_id='e6029f8a2a5e40eba4972f2d9dcf72b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Creating volume d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:20:24 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa820b39-42e3-4e48-a008-15b98a50d3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (154a87e3-ddad-4046-ae5e-5e9c05450a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:24 devstack sudo[105167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d 1073741824
Nov 05 15:20:24 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:24 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Volume volume-2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e (2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e): created successfully
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (154a87e3-ddad-4046-ae5e-5e9c05450a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Flow 'volume_create_manager' (6ba97045-deaa-4191-baf0-193a8956f1ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:20:24 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d4b4d8df-e8fc-4422-af07-ac798ad5696d tempest-CreateVolumesFromImageTest-442341105 None] Created volume successfully.
Nov 05 15:20:25 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d 1073741824" returned: 0 in 0.433s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:25 devstack sudo[105172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d
Nov 05 15:20:25 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:25 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d" returned: 0 in 0.266s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:20:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.433s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-606943803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7faa15-1574-44dc-b59b-3dbe68d18608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18b2b52be174553ac8eb15e889fc93d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:24Z,use_quota=True,user_id='e6029f8a2a5e40eba4972f2d9dcf72b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:20:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Creating volume ea7faa15-1574-44dc-b59b-3dbe68d18608 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:20:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:20:25 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:20:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ea7faa15-1574-44dc-b59b-3dbe68d18608 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (631f9ad5-f13f-4405-a1fb-e353be01157c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d4cdbf4-27f2-41ea-8be1-2fff57a640cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:25 devstack sudo[105175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ea7faa15-1574-44dc-b59b-3dbe68d18608 1073741824
Nov 05 15:20:25 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:25 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Volume volume-d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d (d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d): created successfully
Nov 05 15:20:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d4cdbf4-27f2-41ea-8be1-2fff57a640cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Flow 'volume_create_manager' (15ba037e-b7b7-46ad-9e10-5659d5af3011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:20:25 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-8b0b4b93-ad53-4ec0-ac3b-cb2c1de5db74 tempest-CreateVolumesFromImageTest-442341105 None] Created volume successfully.
Nov 05 15:20:25 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ea7faa15-1574-44dc-b59b-3dbe68d18608 1073741824" returned: 0 in 0.427s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ea7faa15-1574-44dc-b59b-3dbe68d18608 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:25 devstack sudo[105180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ea7faa15-1574-44dc-b59b-3dbe68d18608
Nov 05 15:20:25 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:26 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ea7faa15-1574-44dc-b59b-3dbe68d18608" returned: 0 in 0.248s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.861s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-923152587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605aca44-c4f6-43ec-a4fe-ad0cbae00b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fdc89289fad492eaad240e77e7462f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:24Z,use_quota=True,user_id='b8ccb728c73f47e2b380c3f7846d27c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Creating volume 605aca44-c4f6-43ec-a4fe-ad0cbae00b9b {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:20:26 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-605aca44-c4f6-43ec-a4fe-ad0cbae00b9b 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65acf779-eb1a-47d8-93b2-f9defc3f9e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea7faa15-1574-44dc-b59b-3dbe68d18608', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd0faee-5914-45eb-8747-23948e41fe80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:26 devstack sudo[105183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-605aca44-c4f6-43ec-a4fe-ad0cbae00b9b 1073741824
Nov 05 15:20:26 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:26 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Volume volume-ea7faa15-1574-44dc-b59b-3dbe68d18608 (ea7faa15-1574-44dc-b59b-3dbe68d18608): created successfully
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd0faee-5914-45eb-8747-23948e41fe80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Flow 'volume_create_manager' (c04aa88c-78e9-4fbf-8876-455708fa5b83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:20:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-91ad72df-c1d0-44ab-8e9c-3d779c08c6ab tempest-CreateVolumesFromImageTest-442341105 None] Created volume successfully.
Nov 05 15:20:26 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-605aca44-c4f6-43ec-a4fe-ad0cbae00b9b 1073741824" returned: 0 in 0.500s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-605aca44-c4f6-43ec-a4fe-ad0cbae00b9b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:26 devstack sudo[105188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-605aca44-c4f6-43ec-a4fe-ad0cbae00b9b
Nov 05 15:20:26 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:26 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-605aca44-c4f6-43ec-a4fe-ad0cbae00b9b" returned: 0 in 0.240s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.399s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-495924194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17396b3b-8065-41f3-ba18-e430e713d88c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18b2b52be174553ac8eb15e889fc93d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:24Z,use_quota=True,user_id='e6029f8a2a5e40eba4972f2d9dcf72b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Creating volume 17396b3b-8065-41f3-ba18-e430e713d88c {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:20:26 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-17396b3b-8065-41f3-ba18-e430e713d88c 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484db9ed-1406-496e-9162-87b18cc2146e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-605aca44-c4f6-43ec-a4fe-ad0cbae00b9b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f809fc3d-973a-42de-89ea-6c8f385f8436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:26 devstack sudo[105191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-17396b3b-8065-41f3-ba18-e430e713d88c 1073741824
Nov 05 15:20:26 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:27 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Volume volume-605aca44-c4f6-43ec-a4fe-ad0cbae00b9b (605aca44-c4f6-43ec-a4fe-ad0cbae00b9b): created successfully
Nov 05 15:20:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f809fc3d-973a-42de-89ea-6c8f385f8436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Flow 'volume_create_manager' (e1418f7e-f628-40b9-aa4c-00d040d63eec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:20:27 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b3988154-1471-4c18-adc9-238a4b35fa5e tempest-TestMinimumBasicScenario-663859752 None] Created volume successfully.
Nov 05 15:20:27 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-17396b3b-8065-41f3-ba18-e430e713d88c 1073741824" returned: 0 in 0.411s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-17396b3b-8065-41f3-ba18-e430e713d88c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:27 devstack sudo[105196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-17396b3b-8065-41f3-ba18-e430e713d88c
Nov 05 15:20:27 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:27 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-17396b3b-8065-41f3-ba18-e430e713d88c" returned: 0 in 0.279s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:20:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b757c58-30b9-4511-a338-0caf4daff6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17396b3b-8065-41f3-ba18-e430e713d88c', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c3b1cf-2f01-4898-9da5-01481089e113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:27 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Volume volume-17396b3b-8065-41f3-ba18-e430e713d88c (17396b3b-8065-41f3-ba18-e430e713d88c): created successfully
Nov 05 15:20:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c3b1cf-2f01-4898-9da5-01481089e113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Flow 'volume_create_manager' (01f39bb4-f8d9-4778-9481-f46195f51e77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:20:27 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d4199f11-403a-45f9-be26-2992c64603de tempest-CreateVolumesFromImageTest-442341105 None] Created volume successfully.
Nov 05 15:20:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-07a66639-ae33-4d6b-a08a-2d96af33ee44 req-04205cb9-6dcb-4b2b-9433-7db0fa3f3658 tempest-TestMinimumBasicScenario-663859752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-07a66639-ae33-4d6b-a08a-2d96af33ee44 req-04205cb9-6dcb-4b2b-9433-7db0fa3f3658 tempest-TestMinimumBasicScenario-663859752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-07a66639-ae33-4d6b-a08a-2d96af33ee44 req-04205cb9-6dcb-4b2b-9433-7db0fa3f3658 tempest-TestMinimumBasicScenario-663859752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-07a66639-ae33-4d6b-a08a-2d96af33ee44 req-04205cb9-6dcb-4b2b-9433-7db0fa3f3658 tempest-TestMinimumBasicScenario-663859752 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628', 'name': 'volume-605aca44-c4f6-43ec-a4fe-ad0cbae00b9b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f12705a9-e210-41d0-9100-b3af5952d405', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 15:20:28 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-07a66639-ae33-4d6b-a08a-2d96af33ee44 req-04205cb9-6dcb-4b2b-9433-7db0fa3f3658 tempest-TestMinimumBasicScenario-663859752 None] attachment_update completed successfully.
Nov 05 15:20:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-44b05847-826e-4641-b4e6-012fdbde10ab tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "cinder-17396b3b-8065-41f3-ba18-e430e713d88c-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-44b05847-826e-4641-b4e6-012fdbde10ab tempest-CreateVolumesFromImageTest-442341105 None] Lock "cinder-17396b3b-8065-41f3-ba18-e430e713d88c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-44b05847-826e-4641-b4e6-012fdbde10ab tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "cinder-quobyte-17396b3b-8065-41f3-ba18-e430e713d88c" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-44b05847-826e-4641-b4e6-012fdbde10ab tempest-CreateVolumesFromImageTest-442341105 None] Lock "cinder-quobyte-17396b3b-8065-41f3-ba18-e430e713d88c" acquired by "delete_volume" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:29 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffffc9d3-2e13-4650-8573-1edc7bdd3d56]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:20:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-44b05847-826e-4641-b4e6-012fdbde10ab tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-17396b3b-8065-41f3-ba18-e430e713d88c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:29 devstack sudo[105308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-17396b3b-8065-41f3-ba18-e430e713d88c
Nov 05 15:20:29 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:29 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-44b05847-826e-4641-b4e6-012fdbde10ab tempest-CreateVolumesFromImageTest-442341105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-17396b3b-8065-41f3-ba18-e430e713d88c" returned: 0 in 0.480s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-44b05847-826e-4641-b4e6-012fdbde10ab tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-17396b3b-8065-41f3-ba18-e430e713d88c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:29 devstack sudo[105632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-17396b3b-8065-41f3-ba18-e430e713d88c
Nov 05 15:20:29 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:29 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-44b05847-826e-4641-b4e6-012fdbde10ab tempest-CreateVolumesFromImageTest-442341105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-17396b3b-8065-41f3-ba18-e430e713d88c" returned: 0 in 0.286s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-44b05847-826e-4641-b4e6-012fdbde10ab tempest-CreateVolumesFromImageTest-442341105 None] Lock "cinder-quobyte-17396b3b-8065-41f3-ba18-e430e713d88c" released by "delete_volume" :: held 0.840s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:29 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-44b05847-826e-4641-b4e6-012fdbde10ab tempest-CreateVolumesFromImageTest-442341105 None] Created reservations ['880e4b26-4a7c-487d-bbc7-305efb5e93b9', '8478e1e2-ee71-4b90-bed3-fe042001da30', 'ec090766-5f38-4ed6-b0bf-1cc0974f58ab', 'e39defdd-bdb1-4c20-ad6c-ac83c0f64cc8'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:20:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-44b05847-826e-4641-b4e6-012fdbde10ab tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-44b05847-826e-4641-b4e6-012fdbde10ab tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-44b05847-826e-4641-b4e6-012fdbde10ab tempest-CreateVolumesFromImageTest-442341105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-44b05847-826e-4641-b4e6-012fdbde10ab tempest-CreateVolumesFromImageTest-442341105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-44b05847-826e-4641-b4e6-012fdbde10ab tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-44b05847-826e-4641-b4e6-012fdbde10ab tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:30 devstack sudo[105635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:20:30 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d40febf9-5ffb-4fc4-84fe-6fddce03863e tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "cinder-ea7faa15-1574-44dc-b59b-3dbe68d18608-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d40febf9-5ffb-4fc4-84fe-6fddce03863e tempest-CreateVolumesFromImageTest-442341105 None] Lock "cinder-ea7faa15-1574-44dc-b59b-3dbe68d18608-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d40febf9-5ffb-4fc4-84fe-6fddce03863e tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "cinder-quobyte-ea7faa15-1574-44dc-b59b-3dbe68d18608" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d40febf9-5ffb-4fc4-84fe-6fddce03863e tempest-CreateVolumesFromImageTest-442341105 None] Lock "cinder-quobyte-ea7faa15-1574-44dc-b59b-3dbe68d18608" acquired by "delete_volume" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:30 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:30 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bc9a43-15fd-4661-85b5-bf0ba8c71510]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:20:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d40febf9-5ffb-4fc4-84fe-6fddce03863e tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ea7faa15-1574-44dc-b59b-3dbe68d18608 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-44b05847-826e-4641-b4e6-012fdbde10ab tempest-CreateVolumesFromImageTest-442341105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.319s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:30 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-44b05847-826e-4641-b4e6-012fdbde10ab tempest-CreateVolumesFromImageTest-442341105 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:20:30 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-44b05847-826e-4641-b4e6-012fdbde10ab tempest-CreateVolumesFromImageTest-442341105 None] Deleted volume successfully.
Nov 05 15:20:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-44b05847-826e-4641-b4e6-012fdbde10ab tempest-CreateVolumesFromImageTest-442341105 None] Lock "cinder-17396b3b-8065-41f3-ba18-e430e713d88c-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:30 devstack sudo[105638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ea7faa15-1574-44dc-b59b-3dbe68d18608
Nov 05 15:20:30 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:30 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d40febf9-5ffb-4fc4-84fe-6fddce03863e tempest-CreateVolumesFromImageTest-442341105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ea7faa15-1574-44dc-b59b-3dbe68d18608" returned: 0 in 0.429s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d40febf9-5ffb-4fc4-84fe-6fddce03863e tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ea7faa15-1574-44dc-b59b-3dbe68d18608 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:30 devstack sudo[105644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ea7faa15-1574-44dc-b59b-3dbe68d18608
Nov 05 15:20:30 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:30 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d40febf9-5ffb-4fc4-84fe-6fddce03863e tempest-CreateVolumesFromImageTest-442341105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-ea7faa15-1574-44dc-b59b-3dbe68d18608" returned: 0 in 0.263s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d40febf9-5ffb-4fc4-84fe-6fddce03863e tempest-CreateVolumesFromImageTest-442341105 None] Lock "cinder-quobyte-ea7faa15-1574-44dc-b59b-3dbe68d18608" released by "delete_volume" :: held 0.744s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:31 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-d40febf9-5ffb-4fc4-84fe-6fddce03863e tempest-CreateVolumesFromImageTest-442341105 None] Created reservations ['92ba8432-afde-425e-918b-cc376be4f4a1', '5cd5dbd4-ce22-4bd9-b00d-9345df4a2a88', '966fd4a3-f8a2-4f56-85df-ee451ee63394', '745b4bed-e979-49c6-b942-f5691b40ab46'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:20:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d40febf9-5ffb-4fc4-84fe-6fddce03863e tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d40febf9-5ffb-4fc4-84fe-6fddce03863e tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d40febf9-5ffb-4fc4-84fe-6fddce03863e tempest-CreateVolumesFromImageTest-442341105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d40febf9-5ffb-4fc4-84fe-6fddce03863e tempest-CreateVolumesFromImageTest-442341105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d40febf9-5ffb-4fc4-84fe-6fddce03863e tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d40febf9-5ffb-4fc4-84fe-6fddce03863e tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:31 devstack sudo[105647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:20:31 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a904bada-87e8-4788-9687-2eac173ed9f0 tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "cinder-d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a904bada-87e8-4788-9687-2eac173ed9f0 tempest-CreateVolumesFromImageTest-442341105 None] Lock "cinder-d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a904bada-87e8-4788-9687-2eac173ed9f0 tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "cinder-quobyte-d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:31 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d40febf9-5ffb-4fc4-84fe-6fddce03863e tempest-CreateVolumesFromImageTest-442341105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.345s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:31 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-d40febf9-5ffb-4fc4-84fe-6fddce03863e tempest-CreateVolumesFromImageTest-442341105 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:20:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a904bada-87e8-4788-9687-2eac173ed9f0 tempest-CreateVolumesFromImageTest-442341105 None] Lock "cinder-quobyte-d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d" acquired by "delete_volume" :: waited 0.037s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:31 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d40febf9-5ffb-4fc4-84fe-6fddce03863e tempest-CreateVolumesFromImageTest-442341105 None] Deleted volume successfully.
Nov 05 15:20:31 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d442c520-9a70-4e63-a3a3-a0e22f6d24f6]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:20:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a904bada-87e8-4788-9687-2eac173ed9f0 tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d40febf9-5ffb-4fc4-84fe-6fddce03863e tempest-CreateVolumesFromImageTest-442341105 None] Lock "cinder-ea7faa15-1574-44dc-b59b-3dbe68d18608-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:31 devstack sudo[105650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d
Nov 05 15:20:31 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:31 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a904bada-87e8-4788-9687-2eac173ed9f0 tempest-CreateVolumesFromImageTest-442341105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d" returned: 0 in 0.404s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a904bada-87e8-4788-9687-2eac173ed9f0 tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:31 devstack sudo[105655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d
Nov 05 15:20:31 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:32 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a904bada-87e8-4788-9687-2eac173ed9f0 tempest-CreateVolumesFromImageTest-442341105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d" returned: 0 in 0.308s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a904bada-87e8-4788-9687-2eac173ed9f0 tempest-CreateVolumesFromImageTest-442341105 None] Lock "cinder-quobyte-d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d" released by "delete_volume" :: held 0.778s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:32 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-a904bada-87e8-4788-9687-2eac173ed9f0 tempest-CreateVolumesFromImageTest-442341105 None] Created reservations ['95d8a285-6225-45e6-8348-ca941d81e1d1', '90ba04c4-b02e-4711-81aa-c16a4e628e3c', 'a457c9a9-6986-4db5-8518-1907cff51098', '88d62c31-cd1a-4d6b-8638-1706e102cb4b'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:20:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a904bada-87e8-4788-9687-2eac173ed9f0 tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a904bada-87e8-4788-9687-2eac173ed9f0 tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a904bada-87e8-4788-9687-2eac173ed9f0 tempest-CreateVolumesFromImageTest-442341105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a904bada-87e8-4788-9687-2eac173ed9f0 tempest-CreateVolumesFromImageTest-442341105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a904bada-87e8-4788-9687-2eac173ed9f0 tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a904bada-87e8-4788-9687-2eac173ed9f0 tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:32 devstack sudo[105659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:20:32 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e2f88b13-3f75-4635-b804-e0012b0b8210 tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "cinder-2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e2f88b13-3f75-4635-b804-e0012b0b8210 tempest-CreateVolumesFromImageTest-442341105 None] Lock "cinder-2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:32 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a904bada-87e8-4788-9687-2eac173ed9f0 tempest-CreateVolumesFromImageTest-442341105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.347s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:32 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a904bada-87e8-4788-9687-2eac173ed9f0 tempest-CreateVolumesFromImageTest-442341105 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:20:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e2f88b13-3f75-4635-b804-e0012b0b8210 tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "cinder-quobyte-2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:32 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a904bada-87e8-4788-9687-2eac173ed9f0 tempest-CreateVolumesFromImageTest-442341105 None] Deleted volume successfully.
Nov 05 15:20:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e2f88b13-3f75-4635-b804-e0012b0b8210 tempest-CreateVolumesFromImageTest-442341105 None] Lock "cinder-quobyte-2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e" acquired by "delete_volume" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a904bada-87e8-4788-9687-2eac173ed9f0 tempest-CreateVolumesFromImageTest-442341105 None] Lock "cinder-d0b2c8e3-c2d0-4bcb-a0f7-2871ce5d635d-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:32 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed02fe8-0b10-4b8e-aaa2-49cc2bd86ea3]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:20:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e2f88b13-3f75-4635-b804-e0012b0b8210 tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:32 devstack sudo[105662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e
Nov 05 15:20:32 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:33 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e2f88b13-3f75-4635-b804-e0012b0b8210 tempest-CreateVolumesFromImageTest-442341105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e" returned: 0 in 0.402s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e2f88b13-3f75-4635-b804-e0012b0b8210 tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:33 devstack sudo[105668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e
Nov 05 15:20:33 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:33 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e2f88b13-3f75-4635-b804-e0012b0b8210 tempest-CreateVolumesFromImageTest-442341105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e" returned: 0 in 0.274s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e2f88b13-3f75-4635-b804-e0012b0b8210 tempest-CreateVolumesFromImageTest-442341105 None] Lock "cinder-quobyte-2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e" released by "delete_volume" :: held 0.755s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:33 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-e2f88b13-3f75-4635-b804-e0012b0b8210 tempest-CreateVolumesFromImageTest-442341105 None] Created reservations ['022e25ee-63e0-433a-8096-ca4eadcf7188', '26638aa1-4f69-4818-9185-982e92e0d98e', '7cc62d77-fefc-4bdc-a354-fa289437f8af', '65856f3a-c7a7-4587-815c-14378baadb75'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:20:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e2f88b13-3f75-4635-b804-e0012b0b8210 tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e2f88b13-3f75-4635-b804-e0012b0b8210 tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e2f88b13-3f75-4635-b804-e0012b0b8210 tempest-CreateVolumesFromImageTest-442341105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e2f88b13-3f75-4635-b804-e0012b0b8210 tempest-CreateVolumesFromImageTest-442341105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e2f88b13-3f75-4635-b804-e0012b0b8210 tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e2f88b13-3f75-4635-b804-e0012b0b8210 tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:33 devstack sudo[105678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:20:33 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2dcfea9f-8de6-40a8-a793-f6dd02e10036 tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "cinder-721662e8-36ca-403c-a568-29e4d0333028-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2dcfea9f-8de6-40a8-a793-f6dd02e10036 tempest-CreateVolumesFromImageTest-442341105 None] Lock "cinder-721662e8-36ca-403c-a568-29e4d0333028-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2dcfea9f-8de6-40a8-a793-f6dd02e10036 tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "cinder-quobyte-721662e8-36ca-403c-a568-29e4d0333028" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2dcfea9f-8de6-40a8-a793-f6dd02e10036 tempest-CreateVolumesFromImageTest-442341105 None] Lock "cinder-quobyte-721662e8-36ca-403c-a568-29e4d0333028" acquired by "delete_volume" :: waited 0.038s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:34 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4e8c51-f142-450d-a5d1-672259502e25]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:20:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2dcfea9f-8de6-40a8-a793-f6dd02e10036 tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-721662e8-36ca-403c-a568-29e4d0333028 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:34 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e2f88b13-3f75-4635-b804-e0012b0b8210 tempest-CreateVolumesFromImageTest-442341105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.440s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:34 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-e2f88b13-3f75-4635-b804-e0012b0b8210 tempest-CreateVolumesFromImageTest-442341105 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:20:34 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e2f88b13-3f75-4635-b804-e0012b0b8210 tempest-CreateVolumesFromImageTest-442341105 None] Deleted volume successfully.
Nov 05 15:20:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e2f88b13-3f75-4635-b804-e0012b0b8210 tempest-CreateVolumesFromImageTest-442341105 None] Lock "cinder-2c245d1f-cf56-4b8b-a5e6-58d7aa8d6f5e-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:34 devstack sudo[105696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-721662e8-36ca-403c-a568-29e4d0333028
Nov 05 15:20:34 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:34 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2dcfea9f-8de6-40a8-a793-f6dd02e10036 tempest-CreateVolumesFromImageTest-442341105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-721662e8-36ca-403c-a568-29e4d0333028" returned: 0 in 0.605s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2dcfea9f-8de6-40a8-a793-f6dd02e10036 tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-721662e8-36ca-403c-a568-29e4d0333028 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:34 devstack sudo[105701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-721662e8-36ca-403c-a568-29e4d0333028
Nov 05 15:20:34 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:35 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2dcfea9f-8de6-40a8-a793-f6dd02e10036 tempest-CreateVolumesFromImageTest-442341105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-721662e8-36ca-403c-a568-29e4d0333028" returned: 0 in 0.292s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2dcfea9f-8de6-40a8-a793-f6dd02e10036 tempest-CreateVolumesFromImageTest-442341105 None] Lock "cinder-quobyte-721662e8-36ca-403c-a568-29e4d0333028" released by "delete_volume" :: held 0.967s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:35 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-2dcfea9f-8de6-40a8-a793-f6dd02e10036 tempest-CreateVolumesFromImageTest-442341105 None] Created reservations ['a6ff5192-4264-4127-aea8-40ad3e972d85', '48678da9-9e48-4ac1-9a44-458188f0af26', '2919292f-47cf-4026-8f8a-3bb6812bacb8', 'f959d4e3-1e27-4e9b-9272-664a95760238'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:20:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2dcfea9f-8de6-40a8-a793-f6dd02e10036 tempest-CreateVolumesFromImageTest-442341105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2dcfea9f-8de6-40a8-a793-f6dd02e10036 tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2dcfea9f-8de6-40a8-a793-f6dd02e10036 tempest-CreateVolumesFromImageTest-442341105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2dcfea9f-8de6-40a8-a793-f6dd02e10036 tempest-CreateVolumesFromImageTest-442341105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2dcfea9f-8de6-40a8-a793-f6dd02e10036 tempest-CreateVolumesFromImageTest-442341105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2dcfea9f-8de6-40a8-a793-f6dd02e10036 tempest-CreateVolumesFromImageTest-442341105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:35 devstack sudo[105704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:20:35 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:35 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2dcfea9f-8de6-40a8-a793-f6dd02e10036 tempest-CreateVolumesFromImageTest-442341105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.281s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:35 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-2dcfea9f-8de6-40a8-a793-f6dd02e10036 tempest-CreateVolumesFromImageTest-442341105 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:20:35 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2dcfea9f-8de6-40a8-a793-f6dd02e10036 tempest-CreateVolumesFromImageTest-442341105 None] Deleted volume successfully.
Nov 05 15:20:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2dcfea9f-8de6-40a8-a793-f6dd02e10036 tempest-CreateVolumesFromImageTest-442341105 None] Lock "cinder-721662e8-36ca-403c-a568-29e4d0333028-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:20:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:37 devstack sudo[105715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:20:37 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:37 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.323s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:20:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:20:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 15:20:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread info: [<_MainThread(MainThread, started 136317437956224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136317326340928)>, <Thread(Thread-3 (stat_writer), started daemon 136317326487936)>, <Thread(Rabbit-heartbeat, started daemon 136317321464000)>, <Thread(Thread-5 (_runner), started daemon 136317321550592)>, <Thread(Thread-7 (_runner), started daemon 136317321658496)>, <Thread(fd_logger, started daemon 136317319612992)>, <Thread(privsep_reader, started daemon 136317319622400)>, <Thread(tpool_thread_0, started daemon 136317310928576)>, <Thread(tpool_thread_1, started daemon 136317302535872)>, <Thread(tpool_thread_2, started daemon 136317294143168)>, <Thread(tpool_thread_3, started daemon 136317285750464)>, <Thread(tpool_thread_4, started daemon 136317277357760)>, <Thread(tpool_thread_5, started daemon 136317268965056)>, <Thread(tpool_thread_6, started daemon 136317260572352)>, <Thread(tpool_thread_7, started daemon 136317252179648)>, <Thread(tpool_thread_8, started daemon 136317243786944)>, <Thread(tpool_thread_9, started daemon 136317235394240)>, <Thread(tpool_thread_10, started daemon 136317227001536)>, <Thread(tpool_thread_11, started daemon 136317218608832)>, <Thread(tpool_thread_12, started daemon 136317210216128)>, <Thread(tpool_thread_13, started daemon 136317201807040)>, <Thread(tpool_thread_14, started daemon 136317193397952)>, <Thread(tpool_thread_15, started daemon 136317184988864)>, <Thread(tpool_thread_16, started daemon 136317176579776)>, <Thread(tpool_thread_17, started daemon 136317168170688)>, <Thread(tpool_thread_18, started daemon 136317159761600)>, <Thread(tpool_thread_19, started daemon 136317151352512)>] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Flow 'volume_create_manager' (f102eaf3-5aaf-45d3-a802-cee477863e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a33c8ce0-5c49-42de-91d2-5a4424c5ee01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a33c8ce0-5c49-42de-91d2-5a4424c5ee01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-491524164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65912a1d-7cbc-45d2-9c30-d526446af9d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8c7c049c9b46268dc4ae381a1099d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:39Z,use_quota=True,user_id='d85110662cdd41859ec770f59850233a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9fa93d-ba0b-4445-aab9-5409a68fea93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9fa93d-ba0b-4445-aab9-5409a68fea93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a7bc9d-39d3-4cf1-b2c5-b252fdd8eb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a7bc9d-39d3-4cf1-b2c5-b252fdd8eb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65912a1d-7cbc-45d2-9c30-d526446af9d2', 'volume_name': 'volume-65912a1d-7cbc-45d2-9c30-d526446af9d2', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (890f3817-5469-4eda-bcd9-cbf2caab1160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (890f3817-5469-4eda-bcd9-cbf2caab1160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567b607f-5508-4899-b0f4-b462231d0058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:39 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Volume 65912a1d-7cbc-45d2-9c30-d526446af9d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65912a1d-7cbc-45d2-9c30-d526446af9d2', 'volume_size': 1}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-491524164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65912a1d-7cbc-45d2-9c30-d526446af9d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8c7c049c9b46268dc4ae381a1099d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:39Z,use_quota=True,user_id='d85110662cdd41859ec770f59850233a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Creating volume 65912a1d-7cbc-45d2-9c30-d526446af9d2 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:20:39 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:39 devstack sudo[105720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2 1073741824
Nov 05 15:20:39 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:39 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2 1073741824" returned: 0 in 0.412s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:39 devstack sudo[105725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2
Nov 05 15:20:39 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:39 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2" returned: 0 in 0.243s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567b607f-5508-4899-b0f4-b462231d0058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65912a1d-7cbc-45d2-9c30-d526446af9d2', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2779fc73-0bfe-48f7-871d-03068be77b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:39 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Volume volume-65912a1d-7cbc-45d2-9c30-d526446af9d2 (65912a1d-7cbc-45d2-9c30-d526446af9d2): created successfully
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2779fc73-0bfe-48f7-871d-03068be77b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Flow 'volume_create_manager' (f102eaf3-5aaf-45d3-a802-cee477863e8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:20:39 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-51cc6808-71ea-49a7-9410-530bafb7975f tempest-CreateVolumesFromSnapshotTest-1945050382 None] Created volume successfully.
Nov 05 15:20:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4759f32d-b434-4689-adc6-dfdd0ca95da7 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4759f32d-b434-4689-adc6-dfdd0ca95da7 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4759f32d-b434-4689-adc6-dfdd0ca95da7 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Creating offline snapshot f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f of volume 65912a1d-7cbc-45d2-9c30-d526446af9d2 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:20:40 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18caa7d-9234-4b27-9767-76059efde641]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:20:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4759f32d-b434-4689-adc6-dfdd0ca95da7 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:40 devstack sudo[105728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2
Nov 05 15:20:40 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:40 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4759f32d-b434-4689-adc6-dfdd0ca95da7 tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2" returned: 0 in 0.356s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4759f32d-b434-4689-adc6-dfdd0ca95da7 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:40 devstack sudo[105733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f 1G
Nov 05 15:20:40 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:41 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4759f32d-b434-4689-adc6-dfdd0ca95da7 tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f 1G" returned: 0 in 0.376s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4759f32d-b434-4689-adc6-dfdd0ca95da7 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65912a1d-7cbc-45d2-9c30-d526446af9d2 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:41 devstack sudo[105738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65912a1d-7cbc-45d2-9c30-d526446af9d2 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f
Nov 05 15:20:41 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:41 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4759f32d-b434-4689-adc6-dfdd0ca95da7 tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65912a1d-7cbc-45d2-9c30-d526446af9d2 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f" returned: 0 in 0.322s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:41 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-4759f32d-b434-4689-adc6-dfdd0ca95da7 tempest-CreateVolumesFromSnapshotTest-1945050382 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f is being set with open permissions: ugo+rw
Nov 05 15:20:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4759f32d-b434-4689-adc6-dfdd0ca95da7 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:41 devstack sudo[105743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f
Nov 05 15:20:41 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:41 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4759f32d-b434-4689-adc6-dfdd0ca95da7 tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f" returned: 0 in 0.257s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4759f32d-b434-4689-adc6-dfdd0ca95da7 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:41 devstack sudo[105746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.info
Nov 05 15:20:41 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:41 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4759f32d-b434-4689-adc6-dfdd0ca95da7 tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.info" returned: 0 in 0.255s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:41 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-4759f32d-b434-4689-adc6-dfdd0ca95da7 tempest-CreateVolumesFromSnapshotTest-1945050382 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.info is being set with open permissions: ugo+rw
Nov 05 15:20:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4759f32d-b434-4689-adc6-dfdd0ca95da7 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:41 devstack sudo[105749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.info
Nov 05 15:20:41 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:42 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4759f32d-b434-4689-adc6-dfdd0ca95da7 tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.info" returned: 0 in 0.235s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4759f32d-b434-4689-adc6-dfdd0ca95da7 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.895s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:42 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4759f32d-b434-4689-adc6-dfdd0ca95da7 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Create snapshot completed successfully
Nov 05 15:20:42 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:20:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Flow 'volume_create_manager' (6ff7bca0-ad83-4689-af8c-088293bc14f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:20:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9daafae5-f9dc-4a82-b5d0-2871d0809d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9daafae5-f9dc-4a82-b5d0-2871d0809d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2002829524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e9e1297-a729-433b-b57b-8acb5bea5847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8c7c049c9b46268dc4ae381a1099d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:43Z,use_quota=True,user_id='d85110662cdd41859ec770f59850233a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd3c33c-1fa7-4821-a744-b5ab55398760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd3c33c-1fa7-4821-a744-b5ab55398760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3bc3f1-2eab-4f21-a650-0daad7eb67e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3bc3f1-2eab-4f21-a650-0daad7eb67e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e9e1297-a729-433b-b57b-8acb5bea5847', 'volume_name': 'volume-1e9e1297-a729-433b-b57b-8acb5bea5847', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6303392-44e2-44fd-a44b-d6e4a7efc75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6303392-44e2-44fd-a44b-d6e4a7efc75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6da0289-02d1-4d46-b511-b8e841f84d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:42 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Volume 1e9e1297-a729-433b-b57b-8acb5bea5847: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e9e1297-a729-433b-b57b-8acb5bea5847', 'volume_size': 1}
Nov 05 15:20:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2002829524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e9e1297-a729-433b-b57b-8acb5bea5847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8c7c049c9b46268dc4ae381a1099d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:43Z,use_quota=True,user_id='d85110662cdd41859ec770f59850233a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Creating volume 1e9e1297-a729-433b-b57b-8acb5bea5847 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:20:43 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1e9e1297-a729-433b-b57b-8acb5bea5847 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:43 devstack sudo[105752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1e9e1297-a729-433b-b57b-8acb5bea5847 1073741824
Nov 05 15:20:43 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Flow 'volume_create_manager' (8476aac9-98a8-4c15-8f91-bd6fff4c2970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bca0ba3-72d9-4277-a4e8-1c88929a8df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bca0ba3-72d9-4277-a4e8-1c88929a8df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1615638993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de08f0da-fdd6-47e3-94d0-6b4a26328571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8c7c049c9b46268dc4ae381a1099d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:43Z,use_quota=True,user_id='d85110662cdd41859ec770f59850233a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17bcccca-8cc7-4b29-9730-e8b6a295d20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17bcccca-8cc7-4b29-9730-e8b6a295d20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c0af5c7-04da-466b-9148-3ca4d864b4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c0af5c7-04da-466b-9148-3ca4d864b4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de08f0da-fdd6-47e3-94d0-6b4a26328571', 'volume_name': 'volume-de08f0da-fdd6-47e3-94d0-6b4a26328571', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c50f0570-e8a0-4311-af7c-354ba6b2434d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c50f0570-e8a0-4311-af7c-354ba6b2434d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e242eb6-f116-4814-b639-d0962139065a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:43 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Volume de08f0da-fdd6-47e3-94d0-6b4a26328571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de08f0da-fdd6-47e3-94d0-6b4a26328571', 'volume_size': 1}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:43 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1e9e1297-a729-433b-b57b-8acb5bea5847 1073741824" returned: 0 in 0.612s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1e9e1297-a729-433b-b57b-8acb5bea5847 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:43 devstack sudo[105758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1e9e1297-a729-433b-b57b-8acb5bea5847
Nov 05 15:20:43 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Flow 'volume_create_manager' (6e47891d-59be-4b9c-9e34-a929fe67adea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b383533b-169f-4cd3-a472-608d8f321b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b383533b-169f-4cd3-a472-608d8f321b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-800467027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df5593df-a70c-4693-b1d7-834da0269be2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8c7c049c9b46268dc4ae381a1099d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:44Z,use_quota=True,user_id='d85110662cdd41859ec770f59850233a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39fd035-20a4-4179-92c9-90c875748cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39fd035-20a4-4179-92c9-90c875748cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7fd570c-b11b-44ea-8523-6be0980cf010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7fd570c-b11b-44ea-8523-6be0980cf010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df5593df-a70c-4693-b1d7-834da0269be2', 'volume_name': 'volume-df5593df-a70c-4693-b1d7-834da0269be2', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d4ad3a-9664-4038-936a-c9564cfc2c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d4ad3a-9664-4038-936a-c9564cfc2c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783bf441-ce07-448e-9b35-d10b3d77e5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:43 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Volume df5593df-a70c-4693-b1d7-834da0269be2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df5593df-a70c-4693-b1d7-834da0269be2', 'volume_size': 1}
Nov 05 15:20:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:44 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1e9e1297-a729-433b-b57b-8acb5bea5847" returned: 0 in 0.382s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.645s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1615638993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de08f0da-fdd6-47e3-94d0-6b4a26328571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8c7c049c9b46268dc4ae381a1099d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:43Z,use_quota=True,user_id='d85110662cdd41859ec770f59850233a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Creating volume de08f0da-fdd6-47e3-94d0-6b4a26328571 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:20:44 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-de08f0da-fdd6-47e3-94d0-6b4a26328571 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6da0289-02d1-4d46-b511-b8e841f84d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e9e1297-a729-433b-b57b-8acb5bea5847', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51382522-6f7d-45de-be94-ce67698b4584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:44 devstack sudo[105761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-de08f0da-fdd6-47e3-94d0-6b4a26328571 1073741824
Nov 05 15:20:44 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:44 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Volume volume-1e9e1297-a729-433b-b57b-8acb5bea5847 (1e9e1297-a729-433b-b57b-8acb5bea5847): created successfully
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51382522-6f7d-45de-be94-ce67698b4584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Flow 'volume_create_manager' (6ff7bca0-ad83-4689-af8c-088293bc14f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:20:44 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-25551bfc-1079-4256-bb8a-aaa37402a02a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Created volume successfully.
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Flow 'volume_create_manager' (e65e8435-df28-4eb2-955d-c43ccd2e4be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc79f3f-3304-467c-bd64-a1b746aa71d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc79f3f-3304-467c-bd64-a1b746aa71d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-360577161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15c548d-e94e-410e-b5a9-24b4e321558f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8c7c049c9b46268dc4ae381a1099d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:44Z,use_quota=True,user_id='d85110662cdd41859ec770f59850233a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005335c2-f845-4c1a-b957-99f68d2e99c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005335c2-f845-4c1a-b957-99f68d2e99c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e05e4f24-d13b-4431-b0ef-0b6e83fc99f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e05e4f24-d13b-4431-b0ef-0b6e83fc99f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b15c548d-e94e-410e-b5a9-24b4e321558f', 'volume_name': 'volume-b15c548d-e94e-410e-b5a9-24b4e321558f', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57316cf5-13ce-48e7-93d3-b505e6b3615c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57316cf5-13ce-48e7-93d3-b505e6b3615c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b786360-8fbd-4b53-a09d-ec8b46ca358d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:44 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Volume b15c548d-e94e-410e-b5a9-24b4e321558f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b15c548d-e94e-410e-b5a9-24b4e321558f', 'volume_size': 1}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:44 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Flow 'volume_create_manager' (12b05b91-8727-4f06-9ab1-35d7baf229f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86aeaf4d-4551-49ff-a246-5c274fceafab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-de08f0da-fdd6-47e3-94d0-6b4a26328571 1073741824" returned: 0 in 0.597s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86aeaf4d-4551-49ff-a246-5c274fceafab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-779401044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25cbe5c0-0551-4450-9f7e-38a5bd7d5f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8c7c049c9b46268dc4ae381a1099d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:45Z,use_quota=True,user_id='d85110662cdd41859ec770f59850233a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6c905b-b17e-408d-a110-8089fb7cb024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6c905b-b17e-408d-a110-8089fb7cb024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e092f20-cce2-488e-b159-00b61b6c62b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e092f20-cce2-488e-b159-00b61b6c62b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25cbe5c0-0551-4450-9f7e-38a5bd7d5f84', 'volume_name': 'volume-25cbe5c0-0551-4450-9f7e-38a5bd7d5f84', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699c6718-32d0-44b9-a755-1442bc28cfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699c6718-32d0-44b9-a755-1442bc28cfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d807eec-8270-4f18-b0e0-95fc45006653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:44 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Volume 25cbe5c0-0551-4450-9f7e-38a5bd7d5f84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25cbe5c0-0551-4450-9f7e-38a5bd7d5f84', 'volume_size': 1}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-de08f0da-fdd6-47e3-94d0-6b4a26328571 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:44 devstack sudo[105769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-de08f0da-fdd6-47e3-94d0-6b4a26328571
Nov 05 15:20:44 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:45 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-de08f0da-fdd6-47e3-94d0-6b4a26328571" returned: 0 in 0.278s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.190s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-800467027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df5593df-a70c-4693-b1d7-834da0269be2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8c7c049c9b46268dc4ae381a1099d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:44Z,use_quota=True,user_id='d85110662cdd41859ec770f59850233a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Creating volume df5593df-a70c-4693-b1d7-834da0269be2 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:20:45 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-df5593df-a70c-4693-b1d7-834da0269be2 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e242eb6-f116-4814-b639-d0962139065a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de08f0da-fdd6-47e3-94d0-6b4a26328571', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e54cf58c-9ff0-4777-838c-970a4f726cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:45 devstack sudo[105772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-df5593df-a70c-4693-b1d7-834da0269be2 1073741824
Nov 05 15:20:45 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:45 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Volume volume-de08f0da-fdd6-47e3-94d0-6b4a26328571 (de08f0da-fdd6-47e3-94d0-6b4a26328571): created successfully
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e54cf58c-9ff0-4777-838c-970a4f726cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Flow 'volume_create_manager' (8476aac9-98a8-4c15-8f91-bd6fff4c2970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:20:45 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0dafd8e2-72c4-495e-851c-6da1981ddf5c tempest-CreateVolumesFromSnapshotTest-1945050382 None] Created volume successfully.
Nov 05 15:20:45 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-df5593df-a70c-4693-b1d7-834da0269be2 1073741824" returned: 0 in 0.469s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-df5593df-a70c-4693-b1d7-834da0269be2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:45 devstack sudo[105778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-df5593df-a70c-4693-b1d7-834da0269be2
Nov 05 15:20:45 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:45 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-df5593df-a70c-4693-b1d7-834da0269be2" returned: 0 in 0.264s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.493s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-360577161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15c548d-e94e-410e-b5a9-24b4e321558f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8c7c049c9b46268dc4ae381a1099d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:44Z,use_quota=True,user_id='d85110662cdd41859ec770f59850233a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Creating volume b15c548d-e94e-410e-b5a9-24b4e321558f {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:20:45 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b15c548d-e94e-410e-b5a9-24b4e321558f 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783bf441-ce07-448e-9b35-d10b3d77e5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df5593df-a70c-4693-b1d7-834da0269be2', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:45 devstack sudo[105781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b15c548d-e94e-410e-b5a9-24b4e321558f 1073741824
Nov 05 15:20:45 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02301b68-98f9-4649-b0fd-3c587283d5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:45 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Volume volume-df5593df-a70c-4693-b1d7-834da0269be2 (df5593df-a70c-4693-b1d7-834da0269be2): created successfully
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02301b68-98f9-4649-b0fd-3c587283d5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Flow 'volume_create_manager' (6e47891d-59be-4b9c-9e34-a929fe67adea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:20:45 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a4fc08fd-71de-4a66-b67d-0c7be09f0e29 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Created volume successfully.
Nov 05 15:20:46 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b15c548d-e94e-410e-b5a9-24b4e321558f 1073741824" returned: 0 in 0.459s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b15c548d-e94e-410e-b5a9-24b4e321558f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:46 devstack sudo[105787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b15c548d-e94e-410e-b5a9-24b4e321558f
Nov 05 15:20:46 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:46 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b15c548d-e94e-410e-b5a9-24b4e321558f" returned: 0 in 0.241s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:20:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.857s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-779401044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25cbe5c0-0551-4450-9f7e-38a5bd7d5f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8c7c049c9b46268dc4ae381a1099d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:45Z,use_quota=True,user_id='d85110662cdd41859ec770f59850233a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:20:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Creating volume 25cbe5c0-0551-4450-9f7e-38a5bd7d5f84 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:20:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:20:46 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:20:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-25cbe5c0-0551-4450-9f7e-38a5bd7d5f84 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:46 devstack sudo[105790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-25cbe5c0-0551-4450-9f7e-38a5bd7d5f84 1073741824
Nov 05 15:20:46 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b786360-8fbd-4b53-a09d-ec8b46ca358d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b15c548d-e94e-410e-b5a9-24b4e321558f', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (776af0a7-1d03-4d58-901c-ec3c33398c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:46 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Volume volume-b15c548d-e94e-410e-b5a9-24b4e321558f (b15c548d-e94e-410e-b5a9-24b4e321558f): created successfully
Nov 05 15:20:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (776af0a7-1d03-4d58-901c-ec3c33398c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Flow 'volume_create_manager' (e65e8435-df28-4eb2-955d-c43ccd2e4be8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:20:46 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f4c2dfab-e8f9-42ba-9922-0c19a927c508 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Created volume successfully.
Nov 05 15:20:47 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-25cbe5c0-0551-4450-9f7e-38a5bd7d5f84 1073741824" returned: 0 in 0.428s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-25cbe5c0-0551-4450-9f7e-38a5bd7d5f84 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:47 devstack sudo[105796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-25cbe5c0-0551-4450-9f7e-38a5bd7d5f84
Nov 05 15:20:47 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:47 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-25cbe5c0-0551-4450-9f7e-38a5bd7d5f84" returned: 0 in 0.239s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:20:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d807eec-8270-4f18-b0e0-95fc45006653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25cbe5c0-0551-4450-9f7e-38a5bd7d5f84', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef64ba35-519a-47dc-9c8b-0b52e5044581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:20:47 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Volume volume-25cbe5c0-0551-4450-9f7e-38a5bd7d5f84 (25cbe5c0-0551-4450-9f7e-38a5bd7d5f84): created successfully
Nov 05 15:20:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef64ba35-519a-47dc-9c8b-0b52e5044581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:20:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Flow 'volume_create_manager' (12b05b91-8727-4f06-9ab1-35d7baf229f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:20:47 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-60754583-1ccf-4a53-ba0e-fd4a714ffcca tempest-CreateVolumesFromSnapshotTest-1945050382 None] Created volume successfully.
Nov 05 15:20:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-713322b1-721b-4a8b-842f-1d6536c3c456 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "cinder-25cbe5c0-0551-4450-9f7e-38a5bd7d5f84-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-713322b1-721b-4a8b-842f-1d6536c3c456 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-25cbe5c0-0551-4450-9f7e-38a5bd7d5f84-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-713322b1-721b-4a8b-842f-1d6536c3c456 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "cinder-quobyte-25cbe5c0-0551-4450-9f7e-38a5bd7d5f84" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-713322b1-721b-4a8b-842f-1d6536c3c456 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-quobyte-25cbe5c0-0551-4450-9f7e-38a5bd7d5f84" acquired by "delete_volume" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:48 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d37f26-0c04-462c-abdd-6fd3abeaf910]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:20:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-713322b1-721b-4a8b-842f-1d6536c3c456 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-25cbe5c0-0551-4450-9f7e-38a5bd7d5f84 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:48 devstack sudo[105805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-25cbe5c0-0551-4450-9f7e-38a5bd7d5f84
Nov 05 15:20:48 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:48 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-713322b1-721b-4a8b-842f-1d6536c3c456 tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-25cbe5c0-0551-4450-9f7e-38a5bd7d5f84" returned: 0 in 0.367s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-713322b1-721b-4a8b-842f-1d6536c3c456 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-25cbe5c0-0551-4450-9f7e-38a5bd7d5f84 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:48 devstack sudo[105812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-25cbe5c0-0551-4450-9f7e-38a5bd7d5f84
Nov 05 15:20:48 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:48 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-713322b1-721b-4a8b-842f-1d6536c3c456 tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-25cbe5c0-0551-4450-9f7e-38a5bd7d5f84" returned: 0 in 0.282s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-713322b1-721b-4a8b-842f-1d6536c3c456 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-quobyte-25cbe5c0-0551-4450-9f7e-38a5bd7d5f84" released by "delete_volume" :: held 0.691s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:48 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-713322b1-721b-4a8b-842f-1d6536c3c456 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Created reservations ['fce60c76-a987-454d-9217-d508257e128c', '2cb7c226-ad49-4927-afa5-cf128db35ba2', '8f29d97c-fefa-467f-ba5e-4a897ea76a3c', '23336f2b-1dc5-4596-b13c-120d59d60c9c'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:20:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-713322b1-721b-4a8b-842f-1d6536c3c456 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-713322b1-721b-4a8b-842f-1d6536c3c456 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-713322b1-721b-4a8b-842f-1d6536c3c456 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-713322b1-721b-4a8b-842f-1d6536c3c456 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-713322b1-721b-4a8b-842f-1d6536c3c456 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-713322b1-721b-4a8b-842f-1d6536c3c456 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:49 devstack sudo[105856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:20:49 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b3f1c60e-1835-4c3b-a4c4-253fe93e2fea tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "cinder-b15c548d-e94e-410e-b5a9-24b4e321558f-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:49 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-713322b1-721b-4a8b-842f-1d6536c3c456 tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.269s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:49 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-713322b1-721b-4a8b-842f-1d6536c3c456 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:20:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b3f1c60e-1835-4c3b-a4c4-253fe93e2fea tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-b15c548d-e94e-410e-b5a9-24b4e321558f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:49 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-713322b1-721b-4a8b-842f-1d6536c3c456 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Deleted volume successfully.
Nov 05 15:20:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-713322b1-721b-4a8b-842f-1d6536c3c456 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-25cbe5c0-0551-4450-9f7e-38a5bd7d5f84-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b3f1c60e-1835-4c3b-a4c4-253fe93e2fea tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "cinder-quobyte-b15c548d-e94e-410e-b5a9-24b4e321558f" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b3f1c60e-1835-4c3b-a4c4-253fe93e2fea tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-quobyte-b15c548d-e94e-410e-b5a9-24b4e321558f" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:49 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5172cf-99f8-4cba-bc17-54c07ae1432c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:20:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3f1c60e-1835-4c3b-a4c4-253fe93e2fea tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b15c548d-e94e-410e-b5a9-24b4e321558f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:49 devstack sudo[105865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b15c548d-e94e-410e-b5a9-24b4e321558f
Nov 05 15:20:49 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:49 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3f1c60e-1835-4c3b-a4c4-253fe93e2fea tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b15c548d-e94e-410e-b5a9-24b4e321558f" returned: 0 in 0.376s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3f1c60e-1835-4c3b-a4c4-253fe93e2fea tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b15c548d-e94e-410e-b5a9-24b4e321558f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:49 devstack sudo[105870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b15c548d-e94e-410e-b5a9-24b4e321558f
Nov 05 15:20:49 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:50 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3f1c60e-1835-4c3b-a4c4-253fe93e2fea tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b15c548d-e94e-410e-b5a9-24b4e321558f" returned: 0 in 0.328s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b3f1c60e-1835-4c3b-a4c4-253fe93e2fea tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-quobyte-b15c548d-e94e-410e-b5a9-24b4e321558f" released by "delete_volume" :: held 0.764s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:50 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b3f1c60e-1835-4c3b-a4c4-253fe93e2fea tempest-CreateVolumesFromSnapshotTest-1945050382 None] Created reservations ['69422a5a-7d6c-4499-92d5-996eccf62881', '4e697ae3-fb11-4a2d-9335-96187bc8a96b', '063fcb09-5338-4b96-a19d-be9463124e9f', 'dae23458-b6f6-4982-9c57-cf473ff5bc96'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:20:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b3f1c60e-1835-4c3b-a4c4-253fe93e2fea tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b3f1c60e-1835-4c3b-a4c4-253fe93e2fea tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b3f1c60e-1835-4c3b-a4c4-253fe93e2fea tempest-CreateVolumesFromSnapshotTest-1945050382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b3f1c60e-1835-4c3b-a4c4-253fe93e2fea tempest-CreateVolumesFromSnapshotTest-1945050382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b3f1c60e-1835-4c3b-a4c4-253fe93e2fea tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3f1c60e-1835-4c3b-a4c4-253fe93e2fea tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:50 devstack sudo[105875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:20:50 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ab331e65-8415-4a81-9a4a-fd6fe01f891e tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "cinder-df5593df-a70c-4693-b1d7-834da0269be2-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ab331e65-8415-4a81-9a4a-fd6fe01f891e tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-df5593df-a70c-4693-b1d7-834da0269be2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ab331e65-8415-4a81-9a4a-fd6fe01f891e tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "cinder-quobyte-df5593df-a70c-4693-b1d7-834da0269be2" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:50 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ab331e65-8415-4a81-9a4a-fd6fe01f891e tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-quobyte-df5593df-a70c-4693-b1d7-834da0269be2" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3f1c60e-1835-4c3b-a4c4-253fe93e2fea tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.287s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:50 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-b3f1c60e-1835-4c3b-a4c4-253fe93e2fea tempest-CreateVolumesFromSnapshotTest-1945050382 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:20:50 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b3f1c60e-1835-4c3b-a4c4-253fe93e2fea tempest-CreateVolumesFromSnapshotTest-1945050382 None] Deleted volume successfully.
Nov 05 15:20:50 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0a50c2-19fb-44ec-ac91-b6bb7637a614]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:20:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ab331e65-8415-4a81-9a4a-fd6fe01f891e tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-df5593df-a70c-4693-b1d7-834da0269be2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b3f1c60e-1835-4c3b-a4c4-253fe93e2fea tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-b15c548d-e94e-410e-b5a9-24b4e321558f-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:50 devstack sudo[105878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-df5593df-a70c-4693-b1d7-834da0269be2
Nov 05 15:20:50 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:50 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ab331e65-8415-4a81-9a4a-fd6fe01f891e tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-df5593df-a70c-4693-b1d7-834da0269be2" returned: 0 in 0.388s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ab331e65-8415-4a81-9a4a-fd6fe01f891e tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-df5593df-a70c-4693-b1d7-834da0269be2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:50 devstack sudo[105883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-df5593df-a70c-4693-b1d7-834da0269be2
Nov 05 15:20:50 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:51 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ab331e65-8415-4a81-9a4a-fd6fe01f891e tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-df5593df-a70c-4693-b1d7-834da0269be2" returned: 0 in 0.255s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ab331e65-8415-4a81-9a4a-fd6fe01f891e tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-quobyte-df5593df-a70c-4693-b1d7-834da0269be2" released by "delete_volume" :: held 0.702s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:51 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-ab331e65-8415-4a81-9a4a-fd6fe01f891e tempest-CreateVolumesFromSnapshotTest-1945050382 None] Created reservations ['3135600c-b98b-4b1b-8f8b-07bd2e499d14', '8bb6e33a-a4a9-4ba6-86e6-2e3b94370816', '4a197cc0-47b3-47cd-b1a6-5d4ce12a21c8', '2852b5fe-777c-4b9a-84c7-42b58e437765'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:20:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ab331e65-8415-4a81-9a4a-fd6fe01f891e tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ab331e65-8415-4a81-9a4a-fd6fe01f891e tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ab331e65-8415-4a81-9a4a-fd6fe01f891e tempest-CreateVolumesFromSnapshotTest-1945050382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ab331e65-8415-4a81-9a4a-fd6fe01f891e tempest-CreateVolumesFromSnapshotTest-1945050382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ab331e65-8415-4a81-9a4a-fd6fe01f891e tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ab331e65-8415-4a81-9a4a-fd6fe01f891e tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:51 devstack sudo[105886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:20:51 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dcd29b28-74b9-46eb-a042-00a6c03ee3f3 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "cinder-de08f0da-fdd6-47e3-94d0-6b4a26328571-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dcd29b28-74b9-46eb-a042-00a6c03ee3f3 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-de08f0da-fdd6-47e3-94d0-6b4a26328571-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dcd29b28-74b9-46eb-a042-00a6c03ee3f3 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "cinder-quobyte-de08f0da-fdd6-47e3-94d0-6b4a26328571" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:51 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dcd29b28-74b9-46eb-a042-00a6c03ee3f3 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-quobyte-de08f0da-fdd6-47e3-94d0-6b4a26328571" acquired by "delete_volume" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ab331e65-8415-4a81-9a4a-fd6fe01f891e tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.320s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:51 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-ab331e65-8415-4a81-9a4a-fd6fe01f891e tempest-CreateVolumesFromSnapshotTest-1945050382 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:20:51 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ab331e65-8415-4a81-9a4a-fd6fe01f891e tempest-CreateVolumesFromSnapshotTest-1945050382 None] Deleted volume successfully.
Nov 05 15:20:51 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[825f22cb-5395-4921-b8fb-ea7fdaa9ba9e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:20:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dcd29b28-74b9-46eb-a042-00a6c03ee3f3 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-de08f0da-fdd6-47e3-94d0-6b4a26328571 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ab331e65-8415-4a81-9a4a-fd6fe01f891e tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-df5593df-a70c-4693-b1d7-834da0269be2-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:51 devstack sudo[105889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-de08f0da-fdd6-47e3-94d0-6b4a26328571
Nov 05 15:20:51 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:52 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dcd29b28-74b9-46eb-a042-00a6c03ee3f3 tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-de08f0da-fdd6-47e3-94d0-6b4a26328571" returned: 0 in 0.396s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dcd29b28-74b9-46eb-a042-00a6c03ee3f3 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-de08f0da-fdd6-47e3-94d0-6b4a26328571 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:52 devstack sudo[105894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-de08f0da-fdd6-47e3-94d0-6b4a26328571
Nov 05 15:20:52 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:52 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dcd29b28-74b9-46eb-a042-00a6c03ee3f3 tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-de08f0da-fdd6-47e3-94d0-6b4a26328571" returned: 0 in 0.256s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dcd29b28-74b9-46eb-a042-00a6c03ee3f3 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-quobyte-de08f0da-fdd6-47e3-94d0-6b4a26328571" released by "delete_volume" :: held 0.707s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:52 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-dcd29b28-74b9-46eb-a042-00a6c03ee3f3 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Created reservations ['deb61a06-bc42-473b-bfd2-070d3f411d01', 'd0728a9e-1099-4be0-903d-a070df7a8c3a', '7d9e2cfc-a53d-48fb-922b-5d7e1990034f', 'eff4157f-3982-49ba-bbb2-69da9189238f'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:20:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dcd29b28-74b9-46eb-a042-00a6c03ee3f3 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dcd29b28-74b9-46eb-a042-00a6c03ee3f3 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dcd29b28-74b9-46eb-a042-00a6c03ee3f3 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dcd29b28-74b9-46eb-a042-00a6c03ee3f3 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dcd29b28-74b9-46eb-a042-00a6c03ee3f3 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dcd29b28-74b9-46eb-a042-00a6c03ee3f3 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:52 devstack sudo[105897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:20:52 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:52 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dcd29b28-74b9-46eb-a042-00a6c03ee3f3 tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.257s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:52 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-dcd29b28-74b9-46eb-a042-00a6c03ee3f3 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:20:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d21fb485-1ad8-40fc-ab86-b67dde2b9a62 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "cinder-1e9e1297-a729-433b-b57b-8acb5bea5847-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:52 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-dcd29b28-74b9-46eb-a042-00a6c03ee3f3 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Deleted volume successfully.
Nov 05 15:20:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d21fb485-1ad8-40fc-ab86-b67dde2b9a62 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-1e9e1297-a729-433b-b57b-8acb5bea5847-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dcd29b28-74b9-46eb-a042-00a6c03ee3f3 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-de08f0da-fdd6-47e3-94d0-6b4a26328571-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d21fb485-1ad8-40fc-ab86-b67dde2b9a62 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "cinder-quobyte-1e9e1297-a729-433b-b57b-8acb5bea5847" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d21fb485-1ad8-40fc-ab86-b67dde2b9a62 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-quobyte-1e9e1297-a729-433b-b57b-8acb5bea5847" acquired by "delete_volume" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:52 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66eb593-0a4d-420c-b31c-15424cb2e621]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:20:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d21fb485-1ad8-40fc-ab86-b67dde2b9a62 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1e9e1297-a729-433b-b57b-8acb5bea5847 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:53 devstack sudo[105900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1e9e1297-a729-433b-b57b-8acb5bea5847
Nov 05 15:20:53 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:53 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d21fb485-1ad8-40fc-ab86-b67dde2b9a62 tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1e9e1297-a729-433b-b57b-8acb5bea5847" returned: 0 in 0.396s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d21fb485-1ad8-40fc-ab86-b67dde2b9a62 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1e9e1297-a729-433b-b57b-8acb5bea5847 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:53 devstack sudo[105905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1e9e1297-a729-433b-b57b-8acb5bea5847
Nov 05 15:20:53 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:53 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d21fb485-1ad8-40fc-ab86-b67dde2b9a62 tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1e9e1297-a729-433b-b57b-8acb5bea5847" returned: 0 in 0.277s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d21fb485-1ad8-40fc-ab86-b67dde2b9a62 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-quobyte-1e9e1297-a729-433b-b57b-8acb5bea5847" released by "delete_volume" :: held 0.718s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:53 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-d21fb485-1ad8-40fc-ab86-b67dde2b9a62 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Created reservations ['8b32ddc2-4677-4ac1-8f9a-6e98a3059aea', '5e78ccb9-f7f8-4d2e-b1f7-f2bb182ae176', '34367b20-7023-4d31-9068-6479843e9340', '2363d263-a138-4d44-b6a6-5d8715460944'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:20:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d21fb485-1ad8-40fc-ab86-b67dde2b9a62 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d21fb485-1ad8-40fc-ab86-b67dde2b9a62 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d21fb485-1ad8-40fc-ab86-b67dde2b9a62 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d21fb485-1ad8-40fc-ab86-b67dde2b9a62 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d21fb485-1ad8-40fc-ab86-b67dde2b9a62 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d21fb485-1ad8-40fc-ab86-b67dde2b9a62 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:53 devstack sudo[105908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:20:53 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-78ba69fd-0aa8-446f-b1a8-d3f76150935a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "cinder-f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-78ba69fd-0aa8-446f-b1a8-d3f76150935a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-78ba69fd-0aa8-446f-b1a8-d3f76150935a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "cinder-quobyte-65912a1d-7cbc-45d2-9c30-d526446af9d2" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-78ba69fd-0aa8-446f-b1a8-d3f76150935a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-quobyte-65912a1d-7cbc-45d2-9c30-d526446af9d2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-78ba69fd-0aa8-446f-b1a8-d3f76150935a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "cinder-quobyte-f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-78ba69fd-0aa8-446f-b1a8-d3f76150935a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-quobyte-f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-78ba69fd-0aa8-446f-b1a8-d3f76150935a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Deleting offline snapshot f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f of volume 65912a1d-7cbc-45d2-9c30-d526446af9d2 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:20:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-78ba69fd-0aa8-446f-b1a8-d3f76150935a tempest-CreateVolumesFromSnapshotTest-1945050382 None] snapshot_file for this snap is: volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:20:54 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d21fb485-1ad8-40fc-ab86-b67dde2b9a62 tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.290s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:54 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-d21fb485-1ad8-40fc-ab86-b67dde2b9a62 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:20:54 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d21fb485-1ad8-40fc-ab86-b67dde2b9a62 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Deleted volume successfully.
Nov 05 15:20:54 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca1b2fa-d90d-4a79-8916-0ba48b1544c1]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:20:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-78ba69fd-0aa8-446f-b1a8-d3f76150935a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d21fb485-1ad8-40fc-ab86-b67dde2b9a62 tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-1e9e1297-a729-433b-b57b-8acb5bea5847-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:54 devstack sudo[105911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f
Nov 05 15:20:54 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:54 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-78ba69fd-0aa8-446f-b1a8-d3f76150935a tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f" returned: 0 in 0.379s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-78ba69fd-0aa8-446f-b1a8-d3f76150935a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65912a1d-7cbc-45d2-9c30-d526446af9d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:20:54 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[54924722-fe71-41fc-962e-9c983a0614b5]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:20:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-78ba69fd-0aa8-446f-b1a8-d3f76150935a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:54 devstack sudo[105916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2
Nov 05 15:20:54 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:54 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-78ba69fd-0aa8-446f-b1a8-d3f76150935a tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2" returned: 0 in 0.378s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-78ba69fd-0aa8-446f-b1a8-d3f76150935a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:54 devstack sudo[105921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f
Nov 05 15:20:54 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:55 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-78ba69fd-0aa8-446f-b1a8-d3f76150935a tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f" returned: 0 in 0.332s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-78ba69fd-0aa8-446f-b1a8-d3f76150935a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:55 devstack sudo[105926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f
Nov 05 15:20:55 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:55 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-78ba69fd-0aa8-446f-b1a8-d3f76150935a tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2.f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f" returned: 0 in 0.254s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-78ba69fd-0aa8-446f-b1a8-d3f76150935a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-quobyte-f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f" released by "_delete_snapshot" :: held 1.452s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-78ba69fd-0aa8-446f-b1a8-d3f76150935a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-quobyte-65912a1d-7cbc-45d2-9c30-d526446af9d2" released by "delete_snapshot" :: held 1.472s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:55 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-78ba69fd-0aa8-446f-b1a8-d3f76150935a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Created reservations ['c207a81a-6367-4b40-ac1d-c66472c71885', 'dbed57ad-0898-46c4-a70a-653154c21112', '5f695ac9-3a3f-4872-a74d-f70c442b2e34', '6f20d244-e2ef-4faf-a80b-1426cade85b2'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:20:55 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-78ba69fd-0aa8-446f-b1a8-d3f76150935a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Delete snapshot completed successfully.
Nov 05 15:20:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-78ba69fd-0aa8-446f-b1a8-d3f76150935a tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-f4feeb93-6646-4a4f-aa1f-3d58f2cbcc1f-delete_snapshot" released by "delete_snapshot" :: held 1.622s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7d6d02d1-427c-4f95-935c-d85eb9aa92ec tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "cinder-65912a1d-7cbc-45d2-9c30-d526446af9d2-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7d6d02d1-427c-4f95-935c-d85eb9aa92ec tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-65912a1d-7cbc-45d2-9c30-d526446af9d2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7d6d02d1-427c-4f95-935c-d85eb9aa92ec tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "cinder-quobyte-65912a1d-7cbc-45d2-9c30-d526446af9d2" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:20:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7d6d02d1-427c-4f95-935c-d85eb9aa92ec tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-quobyte-65912a1d-7cbc-45d2-9c30-d526446af9d2" acquired by "delete_volume" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:20:56 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bad90d-3854-44d3-ae68-53b811c8ddef]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:20:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d6d02d1-427c-4f95-935c-d85eb9aa92ec tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:56 devstack sudo[105929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2
Nov 05 15:20:56 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:56 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d6d02d1-427c-4f95-935c-d85eb9aa92ec tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2" returned: 0 in 0.364s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d6d02d1-427c-4f95-935c-d85eb9aa92ec tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:56 devstack sudo[105934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2
Nov 05 15:20:56 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:56 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d6d02d1-427c-4f95-935c-d85eb9aa92ec tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-65912a1d-7cbc-45d2-9c30-d526446af9d2" returned: 0 in 0.257s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7d6d02d1-427c-4f95-935c-d85eb9aa92ec tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-quobyte-65912a1d-7cbc-45d2-9c30-d526446af9d2" released by "delete_volume" :: held 0.686s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:20:56 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-7d6d02d1-427c-4f95-935c-d85eb9aa92ec tempest-CreateVolumesFromSnapshotTest-1945050382 None] Created reservations ['2762f9c1-0889-4f0a-8e73-f618f9d5fd3a', '42e73233-c9fb-4f35-93ef-022875efdd9e', '24583867-56f9-4359-8376-58a941ddf487', 'a6f42599-8483-402a-b2a5-b988a7fb63ae'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:20:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7d6d02d1-427c-4f95-935c-d85eb9aa92ec tempest-CreateVolumesFromSnapshotTest-1945050382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:20:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7d6d02d1-427c-4f95-935c-d85eb9aa92ec tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:20:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7d6d02d1-427c-4f95-935c-d85eb9aa92ec tempest-CreateVolumesFromSnapshotTest-1945050382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:20:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7d6d02d1-427c-4f95-935c-d85eb9aa92ec tempest-CreateVolumesFromSnapshotTest-1945050382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:20:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7d6d02d1-427c-4f95-935c-d85eb9aa92ec tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:20:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d6d02d1-427c-4f95-935c-d85eb9aa92ec tempest-CreateVolumesFromSnapshotTest-1945050382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:20:57 devstack sudo[105937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:20:57 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:20:57 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root
Nov 05 15:20:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d6d02d1-427c-4f95-935c-d85eb9aa92ec tempest-CreateVolumesFromSnapshotTest-1945050382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.261s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:20:57 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-7d6d02d1-427c-4f95-935c-d85eb9aa92ec tempest-CreateVolumesFromSnapshotTest-1945050382 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:20:57 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7d6d02d1-427c-4f95-935c-d85eb9aa92ec tempest-CreateVolumesFromSnapshotTest-1945050382 None] Deleted volume successfully.
Nov 05 15:20:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7d6d02d1-427c-4f95-935c-d85eb9aa92ec tempest-CreateVolumesFromSnapshotTest-1945050382 None] Lock "cinder-65912a1d-7cbc-45d2-9c30-d526446af9d2-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:00 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:21:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Flow 'volume_create_manager' (7b6e961e-4dbd-4090-90b5-35f36e9b1d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:21:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ac496a-d160-4494-8fda-bc377fe1422c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ac496a-d160-4494-8fda-bc377fe1422c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-695440628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6ac356-656b-4139-a187-13efd5fb76e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc439ab9b1f84e84ac065d0b4bbd53e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:01Z,use_quota=True,user_id='c7caebc269d1459eb54719c31a9377bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2e7723f-1694-41a5-a6d6-a75aa24cee4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2e7723f-1694-41a5-a6d6-a75aa24cee4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a7e2293-b0f5-42ba-87ad-c24a51ddee92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a7e2293-b0f5-42ba-87ad-c24a51ddee92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e6ac356-656b-4139-a187-13efd5fb76e9', 'volume_name': 'volume-1e6ac356-656b-4139-a187-13efd5fb76e9', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaeda66e-b095-46a9-8365-969a4d2c0c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaeda66e-b095-46a9-8365-969a4d2c0c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33bbd396-f265-4af2-a7b0-7b7cf3b83349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:00 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Volume 1e6ac356-656b-4139-a187-13efd5fb76e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e6ac356-656b-4139-a187-13efd5fb76e9', 'volume_size': 1}
Nov 05 15:21:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-695440628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6ac356-656b-4139-a187-13efd5fb76e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc439ab9b1f84e84ac065d0b4bbd53e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:01Z,use_quota=True,user_id='c7caebc269d1459eb54719c31a9377bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:21:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Creating volume 1e6ac356-656b-4139-a187-13efd5fb76e9 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:21:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:21:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:21:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:21:00 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:21:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1e6ac356-656b-4139-a187-13efd5fb76e9 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:01 devstack sudo[105941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1e6ac356-656b-4139-a187-13efd5fb76e9 1073741824
Nov 05 15:21:01 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:01 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1e6ac356-656b-4139-a187-13efd5fb76e9 1073741824" returned: 0 in 0.480s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1e6ac356-656b-4139-a187-13efd5fb76e9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:01 devstack sudo[105946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1e6ac356-656b-4139-a187-13efd5fb76e9
Nov 05 15:21:01 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:01 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1e6ac356-656b-4139-a187-13efd5fb76e9" returned: 0 in 0.259s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:21:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33bbd396-f265-4af2-a7b0-7b7cf3b83349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e6ac356-656b-4139-a187-13efd5fb76e9', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203ea13f-ed40-4837-b44d-a146f581f272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:01 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Volume volume-1e6ac356-656b-4139-a187-13efd5fb76e9 (1e6ac356-656b-4139-a187-13efd5fb76e9): created successfully
Nov 05 15:21:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203ea13f-ed40-4837-b44d-a146f581f272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Flow 'volume_create_manager' (7b6e961e-4dbd-4090-90b5-35f36e9b1d2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:21:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c97a7404-5eee-441e-a90f-1aab0ce95732 tempest-ProjectReaderTests-1292291944 None] Created volume successfully.
Nov 05 15:21:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-095a6daf-64f6-4add-8c58-c791d84b372c tempest-ProjectReaderTests-1292291944 None] Acquiring lock "cinder-1e6ac356-656b-4139-a187-13efd5fb76e9-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-095a6daf-64f6-4add-8c58-c791d84b372c tempest-ProjectReaderTests-1292291944 None] Lock "cinder-1e6ac356-656b-4139-a187-13efd5fb76e9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-095a6daf-64f6-4add-8c58-c791d84b372c tempest-ProjectReaderTests-1292291944 None] Acquiring lock "cinder-quobyte-1e6ac356-656b-4139-a187-13efd5fb76e9" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-095a6daf-64f6-4add-8c58-c791d84b372c tempest-ProjectReaderTests-1292291944 None] Lock "cinder-quobyte-1e6ac356-656b-4139-a187-13efd5fb76e9" acquired by "delete_volume" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:02 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[61058108-3bc3-46ad-8554-e5e887bb4172]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:21:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-095a6daf-64f6-4add-8c58-c791d84b372c tempest-ProjectReaderTests-1292291944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1e6ac356-656b-4139-a187-13efd5fb76e9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:02 devstack sudo[105963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1e6ac356-656b-4139-a187-13efd5fb76e9
Nov 05 15:21:02 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:02 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-095a6daf-64f6-4add-8c58-c791d84b372c tempest-ProjectReaderTests-1292291944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1e6ac356-656b-4139-a187-13efd5fb76e9" returned: 0 in 0.402s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-095a6daf-64f6-4add-8c58-c791d84b372c tempest-ProjectReaderTests-1292291944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1e6ac356-656b-4139-a187-13efd5fb76e9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:02 devstack sudo[105968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1e6ac356-656b-4139-a187-13efd5fb76e9
Nov 05 15:21:02 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:02 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-095a6daf-64f6-4add-8c58-c791d84b372c tempest-ProjectReaderTests-1292291944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1e6ac356-656b-4139-a187-13efd5fb76e9" returned: 0 in 0.249s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-095a6daf-64f6-4add-8c58-c791d84b372c tempest-ProjectReaderTests-1292291944 None] Lock "cinder-quobyte-1e6ac356-656b-4139-a187-13efd5fb76e9" released by "delete_volume" :: held 0.701s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:02 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-095a6daf-64f6-4add-8c58-c791d84b372c tempest-ProjectReaderTests-1292291944 None] Created reservations ['f4eb31c6-34c2-4fb0-b10a-14bfebddbc65', '281755eb-4a46-413e-9558-f37e93bf4b87', 'd24dc14e-d532-4465-8ad2-9391f6a90f12', 'd8c36651-d084-43e1-a34d-ae75d0847b01'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-095a6daf-64f6-4add-8c58-c791d84b372c tempest-ProjectReaderTests-1292291944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-095a6daf-64f6-4add-8c58-c791d84b372c tempest-ProjectReaderTests-1292291944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-095a6daf-64f6-4add-8c58-c791d84b372c tempest-ProjectReaderTests-1292291944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-095a6daf-64f6-4add-8c58-c791d84b372c tempest-ProjectReaderTests-1292291944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-095a6daf-64f6-4add-8c58-c791d84b372c tempest-ProjectReaderTests-1292291944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-095a6daf-64f6-4add-8c58-c791d84b372c tempest-ProjectReaderTests-1292291944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:03 devstack sudo[105971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:21:03 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:03 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-095a6daf-64f6-4add-8c58-c791d84b372c tempest-ProjectReaderTests-1292291944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.244s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-095a6daf-64f6-4add-8c58-c791d84b372c tempest-ProjectReaderTests-1292291944 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:21:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-095a6daf-64f6-4add-8c58-c791d84b372c tempest-ProjectReaderTests-1292291944 None] Deleted volume successfully.
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-095a6daf-64f6-4add-8c58-c791d84b372c tempest-ProjectReaderTests-1292291944 None] Lock "cinder-1e6ac356-656b-4139-a187-13efd5fb76e9-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Flow 'volume_create_manager' (68017639-24c4-40f2-ba0e-0c5922dd61d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef963d90-c345-455b-bb98-efa51ddc3968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef963d90-c345-455b-bb98-efa51ddc3968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1482833280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85a6eb5-067d-4956-aa4d-45001edcc443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc439ab9b1f84e84ac065d0b4bbd53e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:04Z,use_quota=True,user_id='c7caebc269d1459eb54719c31a9377bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e31b3594-f7f5-4168-842f-ab4c6e8bb870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e31b3594-f7f5-4168-842f-ab4c6e8bb870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e3f65a-df3c-4af5-b77c-8db17b065d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e3f65a-df3c-4af5-b77c-8db17b065d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f85a6eb5-067d-4956-aa4d-45001edcc443', 'volume_name': 'volume-f85a6eb5-067d-4956-aa4d-45001edcc443', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ccd994d-eee4-4ade-abc5-ec0e1f04fa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ccd994d-eee4-4ade-abc5-ec0e1f04fa74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19bfb6f6-81ec-47c9-aa1d-44ea0948cbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:03 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Volume f85a6eb5-067d-4956-aa4d-45001edcc443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f85a6eb5-067d-4956-aa4d-45001edcc443', 'volume_size': 1}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1482833280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85a6eb5-067d-4956-aa4d-45001edcc443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc439ab9b1f84e84ac065d0b4bbd53e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:04Z,use_quota=True,user_id='c7caebc269d1459eb54719c31a9377bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Creating volume f85a6eb5-067d-4956-aa4d-45001edcc443 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:21:03 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:21:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f85a6eb5-067d-4956-aa4d-45001edcc443 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:03 devstack sudo[105974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f85a6eb5-067d-4956-aa4d-45001edcc443 1073741824
Nov 05 15:21:03 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:04 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f85a6eb5-067d-4956-aa4d-45001edcc443 1073741824" returned: 0 in 0.415s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f85a6eb5-067d-4956-aa4d-45001edcc443 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:04 devstack sudo[105979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f85a6eb5-067d-4956-aa4d-45001edcc443
Nov 05 15:21:04 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:04 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f85a6eb5-067d-4956-aa4d-45001edcc443" returned: 0 in 0.250s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:21:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19bfb6f6-81ec-47c9-aa1d-44ea0948cbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f85a6eb5-067d-4956-aa4d-45001edcc443', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86fb03db-695a-4013-9e8e-ed7e502e39c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:04 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Volume volume-f85a6eb5-067d-4956-aa4d-45001edcc443 (f85a6eb5-067d-4956-aa4d-45001edcc443): created successfully
Nov 05 15:21:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86fb03db-695a-4013-9e8e-ed7e502e39c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Flow 'volume_create_manager' (68017639-24c4-40f2-ba0e-0c5922dd61d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:21:04 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-712b6d72-ed19-494c-a15e-e00cb7047232 tempest-ProjectReaderTests-1292291944 None] Created volume successfully.
Nov 05 15:21:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-055c35d8-564c-47e9-8df6-a96cd0c40c3e tempest-ProjectReaderTests-1292291944 None] Acquiring lock "cinder-f85a6eb5-067d-4956-aa4d-45001edcc443-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-055c35d8-564c-47e9-8df6-a96cd0c40c3e tempest-ProjectReaderTests-1292291944 None] Lock "cinder-f85a6eb5-067d-4956-aa4d-45001edcc443-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-055c35d8-564c-47e9-8df6-a96cd0c40c3e tempest-ProjectReaderTests-1292291944 None] Acquiring lock "cinder-quobyte-f85a6eb5-067d-4956-aa4d-45001edcc443" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-055c35d8-564c-47e9-8df6-a96cd0c40c3e tempest-ProjectReaderTests-1292291944 None] Lock "cinder-quobyte-f85a6eb5-067d-4956-aa4d-45001edcc443" acquired by "delete_volume" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:04 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5fd6ed-728d-411c-bbc1-b51db6949718]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:21:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-055c35d8-564c-47e9-8df6-a96cd0c40c3e tempest-ProjectReaderTests-1292291944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f85a6eb5-067d-4956-aa4d-45001edcc443 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:04 devstack sudo[105982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f85a6eb5-067d-4956-aa4d-45001edcc443
Nov 05 15:21:04 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:05 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-055c35d8-564c-47e9-8df6-a96cd0c40c3e tempest-ProjectReaderTests-1292291944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f85a6eb5-067d-4956-aa4d-45001edcc443" returned: 0 in 0.353s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-055c35d8-564c-47e9-8df6-a96cd0c40c3e tempest-ProjectReaderTests-1292291944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f85a6eb5-067d-4956-aa4d-45001edcc443 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:05 devstack sudo[105987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f85a6eb5-067d-4956-aa4d-45001edcc443
Nov 05 15:21:05 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:05 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-055c35d8-564c-47e9-8df6-a96cd0c40c3e tempest-ProjectReaderTests-1292291944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-f85a6eb5-067d-4956-aa4d-45001edcc443" returned: 0 in 0.242s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-055c35d8-564c-47e9-8df6-a96cd0c40c3e tempest-ProjectReaderTests-1292291944 None] Lock "cinder-quobyte-f85a6eb5-067d-4956-aa4d-45001edcc443" released by "delete_volume" :: held 0.637s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:05 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-055c35d8-564c-47e9-8df6-a96cd0c40c3e tempest-ProjectReaderTests-1292291944 None] Created reservations ['ff5db2fe-fca6-4e6c-8554-72557e7d3b6a', 'c3e819c1-8aff-438a-aac0-b3dc4f072c15', '78715e45-90a7-4e8c-aa03-d267cb300987', 'd82f8d02-37ce-4f5c-bbb7-0d24fd5a173f'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:21:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-055c35d8-564c-47e9-8df6-a96cd0c40c3e tempest-ProjectReaderTests-1292291944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-055c35d8-564c-47e9-8df6-a96cd0c40c3e tempest-ProjectReaderTests-1292291944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-055c35d8-564c-47e9-8df6-a96cd0c40c3e tempest-ProjectReaderTests-1292291944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:21:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-055c35d8-564c-47e9-8df6-a96cd0c40c3e tempest-ProjectReaderTests-1292291944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:21:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-055c35d8-564c-47e9-8df6-a96cd0c40c3e tempest-ProjectReaderTests-1292291944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-055c35d8-564c-47e9-8df6-a96cd0c40c3e tempest-ProjectReaderTests-1292291944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:05 devstack sudo[105990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:21:05 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:05 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-055c35d8-564c-47e9-8df6-a96cd0c40c3e tempest-ProjectReaderTests-1292291944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.238s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:05 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-055c35d8-564c-47e9-8df6-a96cd0c40c3e tempest-ProjectReaderTests-1292291944 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:21:05 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-055c35d8-564c-47e9-8df6-a96cd0c40c3e tempest-ProjectReaderTests-1292291944 None] Deleted volume successfully.
Nov 05 15:21:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-055c35d8-564c-47e9-8df6-a96cd0c40c3e tempest-ProjectReaderTests-1292291944 None] Lock "cinder-f85a6eb5-067d-4956-aa4d-45001edcc443-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:13 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-0853eef6-eb73-43c3-a3c3-41e4c7c901b1 req-a704d653-2663-48d6-89c1-588e3e2f7b1e tempest-TestMinimumBasicScenario-663859752 None] Terminate volume connection completed successfully.
Nov 05 15:21:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-0853eef6-eb73-43c3-a3c3-41e4c7c901b1 req-a704d653-2663-48d6-89c1-588e3e2f7b1e tempest-TestMinimumBasicScenario-663859752 None] Deleting attachment f12705a9-e210-41d0-9100-b3af5952d405. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 15:21:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d34ee9fc-0416-49aa-ad76-43477bd231be tempest-TestMinimumBasicScenario-663859752 None] Acquiring lock "cinder-605aca44-c4f6-43ec-a4fe-ad0cbae00b9b-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d34ee9fc-0416-49aa-ad76-43477bd231be tempest-TestMinimumBasicScenario-663859752 None] Lock "cinder-605aca44-c4f6-43ec-a4fe-ad0cbae00b9b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d34ee9fc-0416-49aa-ad76-43477bd231be tempest-TestMinimumBasicScenario-663859752 None] Acquiring lock "cinder-quobyte-605aca44-c4f6-43ec-a4fe-ad0cbae00b9b" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d34ee9fc-0416-49aa-ad76-43477bd231be tempest-TestMinimumBasicScenario-663859752 None] Lock "cinder-quobyte-605aca44-c4f6-43ec-a4fe-ad0cbae00b9b" acquired by "delete_volume" :: waited 0.013s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:14 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac931fb3-d98a-48c4-af14-30fab69bf035]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:21:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d34ee9fc-0416-49aa-ad76-43477bd231be tempest-TestMinimumBasicScenario-663859752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-605aca44-c4f6-43ec-a4fe-ad0cbae00b9b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:14 devstack sudo[106005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-605aca44-c4f6-43ec-a4fe-ad0cbae00b9b
Nov 05 15:21:14 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:15 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d34ee9fc-0416-49aa-ad76-43477bd231be tempest-TestMinimumBasicScenario-663859752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-605aca44-c4f6-43ec-a4fe-ad0cbae00b9b" returned: 0 in 0.360s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d34ee9fc-0416-49aa-ad76-43477bd231be tempest-TestMinimumBasicScenario-663859752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-605aca44-c4f6-43ec-a4fe-ad0cbae00b9b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:15 devstack sudo[106011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-605aca44-c4f6-43ec-a4fe-ad0cbae00b9b
Nov 05 15:21:15 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:15 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d34ee9fc-0416-49aa-ad76-43477bd231be tempest-TestMinimumBasicScenario-663859752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-605aca44-c4f6-43ec-a4fe-ad0cbae00b9b" returned: 0 in 0.244s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d34ee9fc-0416-49aa-ad76-43477bd231be tempest-TestMinimumBasicScenario-663859752 None] Lock "cinder-quobyte-605aca44-c4f6-43ec-a4fe-ad0cbae00b9b" released by "delete_volume" :: held 0.647s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:15 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-d34ee9fc-0416-49aa-ad76-43477bd231be tempest-TestMinimumBasicScenario-663859752 None] Created reservations ['95c4d4df-d201-4d8d-9ebe-71b9917b8430', 'd3f3a827-aebc-4fee-b7fe-fca27c499e2b', 'e614cc48-3c0f-45d2-8ddb-5e868f126781', 'f87668bf-deb0-4a39-b872-c404afb9cb03'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:21:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d34ee9fc-0416-49aa-ad76-43477bd231be tempest-TestMinimumBasicScenario-663859752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d34ee9fc-0416-49aa-ad76-43477bd231be tempest-TestMinimumBasicScenario-663859752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d34ee9fc-0416-49aa-ad76-43477bd231be tempest-TestMinimumBasicScenario-663859752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:21:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d34ee9fc-0416-49aa-ad76-43477bd231be tempest-TestMinimumBasicScenario-663859752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:21:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d34ee9fc-0416-49aa-ad76-43477bd231be tempest-TestMinimumBasicScenario-663859752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d34ee9fc-0416-49aa-ad76-43477bd231be tempest-TestMinimumBasicScenario-663859752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:15 devstack sudo[106014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:21:15 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:15 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d34ee9fc-0416-49aa-ad76-43477bd231be tempest-TestMinimumBasicScenario-663859752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.240s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:15 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-d34ee9fc-0416-49aa-ad76-43477bd231be tempest-TestMinimumBasicScenario-663859752 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:21:15 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d34ee9fc-0416-49aa-ad76-43477bd231be tempest-TestMinimumBasicScenario-663859752 None] Deleted volume successfully.
Nov 05 15:21:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d34ee9fc-0416-49aa-ad76-43477bd231be tempest-TestMinimumBasicScenario-663859752 None] Lock "cinder-605aca44-c4f6-43ec-a4fe-ad0cbae00b9b-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:25 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=171,cinder:SELECT=106,cinder:INSERT=40,cinder:DELETE=12 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:21:25 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=124,cinder:UPDATE=155,cinder:DELETE=17,cinder:INSERT=35 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:21:29 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:21:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Flow 'volume_create_manager' (34879ec9-8995-49d0-af9d-b7c886a8ab44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:21:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b33767-5b66-4697-89f2-674da2b7abd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b33767-5b66-4697-89f2-674da2b7abd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1732046118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f6f9210-7577-4fd5-8c48-38ffff8ce37c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='911b1ccb7139481ab9eb46230ae6277f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:29Z,use_quota=True,user_id='3e4704e7873f464a927f80b7caf90d29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b663e4-ad35-474a-bb22-aee94f3051de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b663e4-ad35-474a-bb22-aee94f3051de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a274f9-df27-4cc3-9aa0-d8c166713368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a274f9-df27-4cc3-9aa0-d8c166713368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f6f9210-7577-4fd5-8c48-38ffff8ce37c', 'volume_name': 'volume-3f6f9210-7577-4fd5-8c48-38ffff8ce37c', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb6a4f0d-b40d-452d-baf0-62f4e8bd0847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb6a4f0d-b40d-452d-baf0-62f4e8bd0847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c835bae-30e5-42e7-b0ac-af5ef0e2f587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:29 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Volume 3f6f9210-7577-4fd5-8c48-38ffff8ce37c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f6f9210-7577-4fd5-8c48-38ffff8ce37c', 'volume_size': 1}
Nov 05 15:21:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1732046118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f6f9210-7577-4fd5-8c48-38ffff8ce37c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='911b1ccb7139481ab9eb46230ae6277f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:29Z,use_quota=True,user_id='3e4704e7873f464a927f80b7caf90d29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:21:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Creating volume 3f6f9210-7577-4fd5-8c48-38ffff8ce37c {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:21:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:21:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:21:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:21:29 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:21:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3f6f9210-7577-4fd5-8c48-38ffff8ce37c 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:29 devstack sudo[106089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3f6f9210-7577-4fd5-8c48-38ffff8ce37c 1073741824
Nov 05 15:21:29 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:29 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3f6f9210-7577-4fd5-8c48-38ffff8ce37c 1073741824" returned: 0 in 0.424s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3f6f9210-7577-4fd5-8c48-38ffff8ce37c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:30 devstack sudo[106095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3f6f9210-7577-4fd5-8c48-38ffff8ce37c
Nov 05 15:21:30 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:30 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3f6f9210-7577-4fd5-8c48-38ffff8ce37c" returned: 0 in 0.245s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c835bae-30e5-42e7-b0ac-af5ef0e2f587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f6f9210-7577-4fd5-8c48-38ffff8ce37c', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5355cf6a-af6e-46c2-9b40-9b789414a382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:30 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Volume volume-3f6f9210-7577-4fd5-8c48-38ffff8ce37c (3f6f9210-7577-4fd5-8c48-38ffff8ce37c): created successfully
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5355cf6a-af6e-46c2-9b40-9b789414a382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Flow 'volume_create_manager' (34879ec9-8995-49d0-af9d-b7c886a8ab44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:21:30 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-42d828e3-d04c-4456-b3f6-16d098c9e74b tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Created volume successfully.
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Flow 'volume_create_manager' (eb38556b-d78d-47b4-b5f9-782d06f16dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9615cabc-b114-4dab-8acc-cd2af45ac21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9615cabc-b114-4dab-8acc-cd2af45ac21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-749318550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084cc088-d374-428c-a8f4-fdaf130dc5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='911b1ccb7139481ab9eb46230ae6277f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:31Z,use_quota=True,user_id='3e4704e7873f464a927f80b7caf90d29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8db9db24-959d-4d2f-a2f1-41228889a68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8db9db24-959d-4d2f-a2f1-41228889a68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ead7f7f-09de-452a-857a-5f8e7570be3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ead7f7f-09de-452a-857a-5f8e7570be3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '084cc088-d374-428c-a8f4-fdaf130dc5e9', 'volume_name': 'volume-084cc088-d374-428c-a8f4-fdaf130dc5e9', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fafa6db-4242-4252-b6fb-ae996a6cc18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fafa6db-4242-4252-b6fb-ae996a6cc18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e42979b-357b-4de1-841d-cd320ff4e569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:30 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Volume 084cc088-d374-428c-a8f4-fdaf130dc5e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-084cc088-d374-428c-a8f4-fdaf130dc5e9', 'volume_size': 1}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-749318550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084cc088-d374-428c-a8f4-fdaf130dc5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='911b1ccb7139481ab9eb46230ae6277f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:31Z,use_quota=True,user_id='3e4704e7873f464a927f80b7caf90d29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Creating volume 084cc088-d374-428c-a8f4-fdaf130dc5e9 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:21:30 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:21:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-084cc088-d374-428c-a8f4-fdaf130dc5e9 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:31 devstack sudo[106098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-084cc088-d374-428c-a8f4-fdaf130dc5e9 1073741824
Nov 05 15:21:31 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:31 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-084cc088-d374-428c-a8f4-fdaf130dc5e9 1073741824" returned: 0 in 0.494s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Flow 'volume_create_manager' (45da6669-80ad-49dd-8a2b-becbbad9777f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a8fc435-b3fa-4149-a95c-9d3e40645e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a8fc435-b3fa-4149-a95c-9d3e40645e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1613410747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5addb653-11b8-49d2-ae7a-ae51271adfd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='911b1ccb7139481ab9eb46230ae6277f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:31Z,use_quota=True,user_id='3e4704e7873f464a927f80b7caf90d29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00cdc377-0bfd-45fc-9215-cc60e4c373ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00cdc377-0bfd-45fc-9215-cc60e4c373ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a3b05d-40c6-4f2f-a803-3a393fa0fcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a3b05d-40c6-4f2f-a803-3a393fa0fcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5addb653-11b8-49d2-ae7a-ae51271adfd7', 'volume_name': 'volume-5addb653-11b8-49d2-ae7a-ae51271adfd7', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6af93d-a449-48e2-b5b5-ddd07cca87b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6af93d-a449-48e2-b5b5-ddd07cca87b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41076a6f-3145-4a5c-94ad-4931d4323d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:31 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Volume 5addb653-11b8-49d2-ae7a-ae51271adfd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5addb653-11b8-49d2-ae7a-ae51271adfd7', 'volume_size': 1}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-084cc088-d374-428c-a8f4-fdaf130dc5e9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:31 devstack sudo[106104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-084cc088-d374-428c-a8f4-fdaf130dc5e9
Nov 05 15:21:31 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:21:31 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Flow 'volume_create_manager' (dcdb891f-5c5c-4fe9-8925-f26ea3a5a764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f04acea-649f-40c4-85c3-21b19540eccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-084cc088-d374-428c-a8f4-fdaf130dc5e9" returned: 0 in 0.288s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.308s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1613410747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5addb653-11b8-49d2-ae7a-ae51271adfd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='911b1ccb7139481ab9eb46230ae6277f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:31Z,use_quota=True,user_id='3e4704e7873f464a927f80b7caf90d29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Creating volume 5addb653-11b8-49d2-ae7a-ae51271adfd7 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:21:31 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5addb653-11b8-49d2-ae7a-ae51271adfd7 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f04acea-649f-40c4-85c3-21b19540eccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-298999832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b07ae951-6bb1-4c8f-972f-6304bdb3d93d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='911b1ccb7139481ab9eb46230ae6277f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:32Z,use_quota=True,user_id='3e4704e7873f464a927f80b7caf90d29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cfe3c52-6284-41b8-8faf-41975de3db8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:31 devstack sudo[106107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5addb653-11b8-49d2-ae7a-ae51271adfd7 1073741824
Nov 05 15:21:31 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cfe3c52-6284-41b8-8faf-41975de3db8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d4248d7-de69-4964-8117-8c5933041d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d4248d7-de69-4964-8117-8c5933041d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b07ae951-6bb1-4c8f-972f-6304bdb3d93d', 'volume_name': 'volume-b07ae951-6bb1-4c8f-972f-6304bdb3d93d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6519be58-e4cf-4fd3-9f2f-527cd4e154bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6519be58-e4cf-4fd3-9f2f-527cd4e154bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e67412-7192-44f5-bb94-c03db3cfd2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:31 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Volume b07ae951-6bb1-4c8f-972f-6304bdb3d93d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b07ae951-6bb1-4c8f-972f-6304bdb3d93d', 'volume_size': 1}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e42979b-357b-4de1-841d-cd320ff4e569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-084cc088-d374-428c-a8f4-fdaf130dc5e9', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077d3441-ab19-4ff8-8c36-bb5a7019d83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:31 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Volume volume-084cc088-d374-428c-a8f4-fdaf130dc5e9 (084cc088-d374-428c-a8f4-fdaf130dc5e9): created successfully
Nov 05 15:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077d3441-ab19-4ff8-8c36-bb5a7019d83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Flow 'volume_create_manager' (eb38556b-d78d-47b4-b5f9-782d06f16dd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:21:32 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-58fcc141-7f7b-47d7-a221-aebc92797ee1 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Created volume successfully.
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Flow 'volume_create_manager' (f30e9cf7-c6c6-402e-a641-cf46b041ea79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f3221f0-fdc2-4f49-8f06-00c7d1c0ffd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f3221f0-fdc2-4f49-8f06-00c7d1c0ffd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1602524169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a6f3f77-469a-48e7-9334-3ed6e4529ea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='911b1ccb7139481ab9eb46230ae6277f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:32Z,use_quota=True,user_id='3e4704e7873f464a927f80b7caf90d29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6793b9c-3946-4a9f-9af9-10269d28d5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6793b9c-3946-4a9f-9af9-10269d28d5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0829d7a6-e800-4b94-851f-01dfc7e36782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0829d7a6-e800-4b94-851f-01dfc7e36782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a6f3f77-469a-48e7-9334-3ed6e4529ea4', 'volume_name': 'volume-8a6f3f77-469a-48e7-9334-3ed6e4529ea4', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9dcedd-fcc7-49d6-b8c0-487afcb5581d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9dcedd-fcc7-49d6-b8c0-487afcb5581d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c856d82-2a07-4bed-b9ac-5e7e5218ece8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:32 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Volume 8a6f3f77-469a-48e7-9334-3ed6e4529ea4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a6f3f77-469a-48e7-9334-3ed6e4529ea4', 'volume_size': 1}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:32 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5addb653-11b8-49d2-ae7a-ae51271adfd7 1073741824" returned: 0 in 0.524s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5addb653-11b8-49d2-ae7a-ae51271adfd7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:32 devstack sudo[106113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5addb653-11b8-49d2-ae7a-ae51271adfd7
Nov 05 15:21:32 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Flow 'volume_create_manager' (32b6c761-ed6f-4462-888c-f53b2be93e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a593e25-f163-4ebb-847e-c24c6e69e699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a593e25-f163-4ebb-847e-c24c6e69e699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-561563204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77d746a-9c72-4063-8bbf-cb75477fb9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='911b1ccb7139481ab9eb46230ae6277f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:33Z,use_quota=True,user_id='3e4704e7873f464a927f80b7caf90d29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c6bea3-8fed-4dd3-b243-c7009ad00090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c6bea3-8fed-4dd3-b243-c7009ad00090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (401dfe0a-d292-48dd-8a0d-d4f7968727ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (401dfe0a-d292-48dd-8a0d-d4f7968727ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b77d746a-9c72-4063-8bbf-cb75477fb9a4', 'volume_name': 'volume-b77d746a-9c72-4063-8bbf-cb75477fb9a4', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a75b761-30f0-4434-a7fc-66946f1724b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a75b761-30f0-4434-a7fc-66946f1724b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4a970d-72e3-4a49-b357-bdae16af92b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:32 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Volume b77d746a-9c72-4063-8bbf-cb75477fb9a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b77d746a-9c72-4063-8bbf-cb75477fb9a4', 'volume_size': 1}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:32 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5addb653-11b8-49d2-ae7a-ae51271adfd7" returned: 0 in 0.283s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.785s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-298999832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b07ae951-6bb1-4c8f-972f-6304bdb3d93d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='911b1ccb7139481ab9eb46230ae6277f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:32Z,use_quota=True,user_id='3e4704e7873f464a927f80b7caf90d29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Creating volume b07ae951-6bb1-4c8f-972f-6304bdb3d93d {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:21:32 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b07ae951-6bb1-4c8f-972f-6304bdb3d93d 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41076a6f-3145-4a5c-94ad-4931d4323d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5addb653-11b8-49d2-ae7a-ae51271adfd7', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:32 devstack sudo[106116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b07ae951-6bb1-4c8f-972f-6304bdb3d93d 1073741824
Nov 05 15:21:32 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca952a50-8cf8-4658-94cc-6c4d6557ccf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:32 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Volume volume-5addb653-11b8-49d2-ae7a-ae51271adfd7 (5addb653-11b8-49d2-ae7a-ae51271adfd7): created successfully
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca952a50-8cf8-4658-94cc-6c4d6557ccf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Flow 'volume_create_manager' (45da6669-80ad-49dd-8a2b-becbbad9777f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:21:32 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3aed457f-7f3d-459b-b9cc-b3b50656da0d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Created volume successfully.
Nov 05 15:21:33 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b07ae951-6bb1-4c8f-972f-6304bdb3d93d 1073741824" returned: 0 in 0.402s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b07ae951-6bb1-4c8f-972f-6304bdb3d93d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:33 devstack sudo[106121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b07ae951-6bb1-4c8f-972f-6304bdb3d93d
Nov 05 15:21:33 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:33 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b07ae951-6bb1-4c8f-972f-6304bdb3d93d" returned: 0 in 0.257s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:21:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.160s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1602524169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a6f3f77-469a-48e7-9334-3ed6e4529ea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='911b1ccb7139481ab9eb46230ae6277f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:32Z,use_quota=True,user_id='3e4704e7873f464a927f80b7caf90d29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:21:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Creating volume 8a6f3f77-469a-48e7-9334-3ed6e4529ea4 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:21:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:21:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:21:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:21:33 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:21:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8a6f3f77-469a-48e7-9334-3ed6e4529ea4 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e67412-7192-44f5-bb94-c03db3cfd2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b07ae951-6bb1-4c8f-972f-6304bdb3d93d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6418d7e-602f-4601-8267-43fbfaf3218f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:33 devstack sudo[106124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8a6f3f77-469a-48e7-9334-3ed6e4529ea4 1073741824
Nov 05 15:21:33 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:33 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Volume volume-b07ae951-6bb1-4c8f-972f-6304bdb3d93d (b07ae951-6bb1-4c8f-972f-6304bdb3d93d): created successfully
Nov 05 15:21:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6418d7e-602f-4601-8267-43fbfaf3218f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Flow 'volume_create_manager' (dcdb891f-5c5c-4fe9-8925-f26ea3a5a764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:21:33 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6b462e01-a702-44b6-8772-55c5e255cd9f tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Created volume successfully.
Nov 05 15:21:33 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8a6f3f77-469a-48e7-9334-3ed6e4529ea4 1073741824" returned: 0 in 0.456s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8a6f3f77-469a-48e7-9334-3ed6e4529ea4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:33 devstack sudo[106130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8a6f3f77-469a-48e7-9334-3ed6e4529ea4
Nov 05 15:21:33 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:34 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8a6f3f77-469a-48e7-9334-3ed6e4529ea4" returned: 0 in 0.260s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.520s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-561563204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77d746a-9c72-4063-8bbf-cb75477fb9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='911b1ccb7139481ab9eb46230ae6277f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:33Z,use_quota=True,user_id='3e4704e7873f464a927f80b7caf90d29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Creating volume b77d746a-9c72-4063-8bbf-cb75477fb9a4 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:21:34 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b77d746a-9c72-4063-8bbf-cb75477fb9a4 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c856d82-2a07-4bed-b9ac-5e7e5218ece8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a6f3f77-469a-48e7-9334-3ed6e4529ea4', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bae12e3-96dd-42e4-ae45-0c5fab856bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:34 devstack sudo[106133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b77d746a-9c72-4063-8bbf-cb75477fb9a4 1073741824
Nov 05 15:21:34 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:34 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Volume volume-8a6f3f77-469a-48e7-9334-3ed6e4529ea4 (8a6f3f77-469a-48e7-9334-3ed6e4529ea4): created successfully
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bae12e3-96dd-42e4-ae45-0c5fab856bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Flow 'volume_create_manager' (f30e9cf7-c6c6-402e-a641-cf46b041ea79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:21:34 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6bd54ec4-7620-4a52-afec-26a4d68e98b6 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Created volume successfully.
Nov 05 15:21:34 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b77d746a-9c72-4063-8bbf-cb75477fb9a4 1073741824" returned: 0 in 0.421s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b77d746a-9c72-4063-8bbf-cb75477fb9a4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:34 devstack sudo[106138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b77d746a-9c72-4063-8bbf-cb75477fb9a4
Nov 05 15:21:34 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:34 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b77d746a-9c72-4063-8bbf-cb75477fb9a4" returned: 0 in 0.253s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4a970d-72e3-4a49-b357-bdae16af92b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b77d746a-9c72-4063-8bbf-cb75477fb9a4', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a68742-6bca-4cd4-9f4a-06e3c3830612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:34 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Volume volume-b77d746a-9c72-4063-8bbf-cb75477fb9a4 (b77d746a-9c72-4063-8bbf-cb75477fb9a4): created successfully
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a68742-6bca-4cd4-9f4a-06e3c3830612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Flow 'volume_create_manager' (32b6c761-ed6f-4462-888c-f53b2be93e6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:21:34 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-752d13a1-43ee-4052-b579-adbe7cecf696 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Created volume successfully.
Nov 05 15:21:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bdd14314-8842-44a1-bc18-ca48e545ffcb tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "cinder-b77d746a-9c72-4063-8bbf-cb75477fb9a4-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bdd14314-8842-44a1-bc18-ca48e545ffcb tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "cinder-b77d746a-9c72-4063-8bbf-cb75477fb9a4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bdd14314-8842-44a1-bc18-ca48e545ffcb tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "cinder-quobyte-b77d746a-9c72-4063-8bbf-cb75477fb9a4" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bdd14314-8842-44a1-bc18-ca48e545ffcb tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "cinder-quobyte-b77d746a-9c72-4063-8bbf-cb75477fb9a4" acquired by "delete_volume" :: waited 0.013s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:36 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7caa99b-6b9f-47ef-9f18-72585ccb88f5]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:21:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bdd14314-8842-44a1-bc18-ca48e545ffcb tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b77d746a-9c72-4063-8bbf-cb75477fb9a4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:36 devstack sudo[106141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b77d746a-9c72-4063-8bbf-cb75477fb9a4
Nov 05 15:21:36 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:36 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bdd14314-8842-44a1-bc18-ca48e545ffcb tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b77d746a-9c72-4063-8bbf-cb75477fb9a4" returned: 0 in 0.358s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bdd14314-8842-44a1-bc18-ca48e545ffcb tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b77d746a-9c72-4063-8bbf-cb75477fb9a4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:36 devstack sudo[106146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b77d746a-9c72-4063-8bbf-cb75477fb9a4
Nov 05 15:21:36 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:36 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bdd14314-8842-44a1-bc18-ca48e545ffcb tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b77d746a-9c72-4063-8bbf-cb75477fb9a4" returned: 0 in 0.241s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bdd14314-8842-44a1-bc18-ca48e545ffcb tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "cinder-quobyte-b77d746a-9c72-4063-8bbf-cb75477fb9a4" released by "delete_volume" :: held 0.638s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:36 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-bdd14314-8842-44a1-bc18-ca48e545ffcb tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Created reservations ['8e1b0500-99b3-4756-bf1d-75d1627b8fa4', '83faf4f0-bde5-452a-9258-36e497eddb1d', '2366da2d-0c20-4047-8a5b-004c1256cadb', '62ccae83-621d-41d1-90f0-e6c65221c629'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:21:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bdd14314-8842-44a1-bc18-ca48e545ffcb tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bdd14314-8842-44a1-bc18-ca48e545ffcb tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bdd14314-8842-44a1-bc18-ca48e545ffcb tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:21:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bdd14314-8842-44a1-bc18-ca48e545ffcb tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:21:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bdd14314-8842-44a1-bc18-ca48e545ffcb tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bdd14314-8842-44a1-bc18-ca48e545ffcb tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:36 devstack sudo[106149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:21:36 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:37 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bdd14314-8842-44a1-bc18-ca48e545ffcb tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.237s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-bdd14314-8842-44a1-bc18-ca48e545ffcb tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:21:37 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-bdd14314-8842-44a1-bc18-ca48e545ffcb tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Deleted volume successfully.
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bdd14314-8842-44a1-bc18-ca48e545ffcb tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "cinder-b77d746a-9c72-4063-8bbf-cb75477fb9a4-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-88bc5503-133c-401c-97da-4c844f9b4dff tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "cinder-8a6f3f77-469a-48e7-9334-3ed6e4529ea4-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-88bc5503-133c-401c-97da-4c844f9b4dff tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "cinder-8a6f3f77-469a-48e7-9334-3ed6e4529ea4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-88bc5503-133c-401c-97da-4c844f9b4dff tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "cinder-quobyte-8a6f3f77-469a-48e7-9334-3ed6e4529ea4" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-88bc5503-133c-401c-97da-4c844f9b4dff tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "cinder-quobyte-8a6f3f77-469a-48e7-9334-3ed6e4529ea4" acquired by "delete_volume" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e35037-6b1d-44be-9720-8f69c771d8ac]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88bc5503-133c-401c-97da-4c844f9b4dff tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8a6f3f77-469a-48e7-9334-3ed6e4529ea4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:37 devstack sudo[106152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8a6f3f77-469a-48e7-9334-3ed6e4529ea4
Nov 05 15:21:37 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:37 devstack sudo[106156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:21:37 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:37 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:37 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.279s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88bc5503-133c-401c-97da-4c844f9b4dff tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8a6f3f77-469a-48e7-9334-3ed6e4529ea4" returned: 0 in 0.422s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88bc5503-133c-401c-97da-4c844f9b4dff tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8a6f3f77-469a-48e7-9334-3ed6e4529ea4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread info: [<_MainThread(MainThread, started 136317437956224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136317326340928)>, <Thread(Thread-3 (stat_writer), started daemon 136317326487936)>, <Thread(Rabbit-heartbeat, started daemon 136317321464000)>, <Thread(Thread-5 (_runner), started daemon 136317321550592)>, <Thread(Thread-7 (_runner), started daemon 136317321658496)>, <Thread(fd_logger, started daemon 136317319612992)>, <Thread(privsep_reader, started daemon 136317319622400)>, <Thread(tpool_thread_0, started daemon 136317310928576)>, <Thread(tpool_thread_1, started daemon 136317302535872)>, <Thread(tpool_thread_2, started daemon 136317294143168)>, <Thread(tpool_thread_3, started daemon 136317285750464)>, <Thread(tpool_thread_4, started daemon 136317277357760)>, <Thread(tpool_thread_5, started daemon 136317268965056)>, <Thread(tpool_thread_6, started daemon 136317260572352)>, <Thread(tpool_thread_7, started daemon 136317252179648)>, <Thread(tpool_thread_8, started daemon 136317243786944)>, <Thread(tpool_thread_9, started daemon 136317235394240)>, <Thread(tpool_thread_10, started daemon 136317227001536)>, <Thread(tpool_thread_11, started daemon 136317218608832)>, <Thread(tpool_thread_12, started daemon 136317210216128)>, <Thread(tpool_thread_13, started daemon 136317201807040)>, <Thread(tpool_thread_14, started daemon 136317193397952)>, <Thread(tpool_thread_15, started daemon 136317184988864)>, <Thread(tpool_thread_16, started daemon 136317176579776)>, <Thread(tpool_thread_17, started daemon 136317168170688)>, <Thread(tpool_thread_18, started daemon 136317159761600)>, <Thread(tpool_thread_19, started daemon 136317151352512)>] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 15:21:37 devstack sudo[106162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8a6f3f77-469a-48e7-9334-3ed6e4529ea4
Nov 05 15:21:37 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:37 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88bc5503-133c-401c-97da-4c844f9b4dff tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-8a6f3f77-469a-48e7-9334-3ed6e4529ea4" returned: 0 in 0.253s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-88bc5503-133c-401c-97da-4c844f9b4dff tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "cinder-quobyte-8a6f3f77-469a-48e7-9334-3ed6e4529ea4" released by "delete_volume" :: held 0.723s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:37 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-88bc5503-133c-401c-97da-4c844f9b4dff tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Created reservations ['d475bdf5-c6d8-497c-94ce-bfcbd3f642f7', '4cd85d08-9579-4426-8a7b-9b20d3b4f974', 'd91e39d9-d846-4d0d-99e9-7e3ba7cbf01f', '98ce671c-1f8d-4d4f-8a7b-30f51e9e1336'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:21:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-88bc5503-133c-401c-97da-4c844f9b4dff tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-88bc5503-133c-401c-97da-4c844f9b4dff tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-88bc5503-133c-401c-97da-4c844f9b4dff tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:21:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-88bc5503-133c-401c-97da-4c844f9b4dff tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:21:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-88bc5503-133c-401c-97da-4c844f9b4dff tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88bc5503-133c-401c-97da-4c844f9b4dff tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:38 devstack sudo[106165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:21:38 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:38 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88bc5503-133c-401c-97da-4c844f9b4dff tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.247s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:38 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-88bc5503-133c-401c-97da-4c844f9b4dff tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:21:38 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-88bc5503-133c-401c-97da-4c844f9b4dff tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Deleted volume successfully.
Nov 05 15:21:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5fcbdf5b-776f-4047-a3a0-a7e46ac5338e tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "cinder-b07ae951-6bb1-4c8f-972f-6304bdb3d93d-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5fcbdf5b-776f-4047-a3a0-a7e46ac5338e tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "cinder-b07ae951-6bb1-4c8f-972f-6304bdb3d93d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-88bc5503-133c-401c-97da-4c844f9b4dff tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "cinder-8a6f3f77-469a-48e7-9334-3ed6e4529ea4-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5fcbdf5b-776f-4047-a3a0-a7e46ac5338e tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "cinder-quobyte-b07ae951-6bb1-4c8f-972f-6304bdb3d93d" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5fcbdf5b-776f-4047-a3a0-a7e46ac5338e tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "cinder-quobyte-b07ae951-6bb1-4c8f-972f-6304bdb3d93d" acquired by "delete_volume" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:38 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec690f0-5e0a-409c-b4b4-cae36ffd0046]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:21:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5fcbdf5b-776f-4047-a3a0-a7e46ac5338e tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b07ae951-6bb1-4c8f-972f-6304bdb3d93d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:38 devstack sudo[106168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b07ae951-6bb1-4c8f-972f-6304bdb3d93d
Nov 05 15:21:38 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:38 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5fcbdf5b-776f-4047-a3a0-a7e46ac5338e tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b07ae951-6bb1-4c8f-972f-6304bdb3d93d" returned: 0 in 0.362s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5fcbdf5b-776f-4047-a3a0-a7e46ac5338e tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b07ae951-6bb1-4c8f-972f-6304bdb3d93d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:38 devstack sudo[106173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b07ae951-6bb1-4c8f-972f-6304bdb3d93d
Nov 05 15:21:38 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:39 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5fcbdf5b-776f-4047-a3a0-a7e46ac5338e tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b07ae951-6bb1-4c8f-972f-6304bdb3d93d" returned: 0 in 0.251s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5fcbdf5b-776f-4047-a3a0-a7e46ac5338e tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "cinder-quobyte-b07ae951-6bb1-4c8f-972f-6304bdb3d93d" released by "delete_volume" :: held 0.651s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:39 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-5fcbdf5b-776f-4047-a3a0-a7e46ac5338e tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Created reservations ['c2fbcb47-3184-4b07-b6ee-629617b9b127', '7c612e74-bfe6-4c0b-b1f7-8205c9c6ad64', '6c6cfbfa-4c62-4a75-82a5-2cb2aba86d86', 'db50f0cd-4b8b-457a-9ce4-3e94fb403f1c'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:21:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5fcbdf5b-776f-4047-a3a0-a7e46ac5338e tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5fcbdf5b-776f-4047-a3a0-a7e46ac5338e tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5fcbdf5b-776f-4047-a3a0-a7e46ac5338e tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:21:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5fcbdf5b-776f-4047-a3a0-a7e46ac5338e tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:21:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5fcbdf5b-776f-4047-a3a0-a7e46ac5338e tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5fcbdf5b-776f-4047-a3a0-a7e46ac5338e tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:39 devstack sudo[106176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:21:39 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:39 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5fcbdf5b-776f-4047-a3a0-a7e46ac5338e tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.238s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:39 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-5fcbdf5b-776f-4047-a3a0-a7e46ac5338e tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:21:39 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5fcbdf5b-776f-4047-a3a0-a7e46ac5338e tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Deleted volume successfully.
Nov 05 15:21:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5fcbdf5b-776f-4047-a3a0-a7e46ac5338e tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "cinder-b07ae951-6bb1-4c8f-972f-6304bdb3d93d-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e3976503-035d-48e9-b541-dcb3e534d91d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "cinder-5addb653-11b8-49d2-ae7a-ae51271adfd7-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e3976503-035d-48e9-b541-dcb3e534d91d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "cinder-5addb653-11b8-49d2-ae7a-ae51271adfd7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e3976503-035d-48e9-b541-dcb3e534d91d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "cinder-quobyte-5addb653-11b8-49d2-ae7a-ae51271adfd7" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e3976503-035d-48e9-b541-dcb3e534d91d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "cinder-quobyte-5addb653-11b8-49d2-ae7a-ae51271adfd7" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:39 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b76b0f-f044-4daf-926c-30c669f2df9c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:21:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e3976503-035d-48e9-b541-dcb3e534d91d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5addb653-11b8-49d2-ae7a-ae51271adfd7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:39 devstack sudo[106180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5addb653-11b8-49d2-ae7a-ae51271adfd7
Nov 05 15:21:39 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:39 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e3976503-035d-48e9-b541-dcb3e534d91d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5addb653-11b8-49d2-ae7a-ae51271adfd7" returned: 0 in 0.358s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e3976503-035d-48e9-b541-dcb3e534d91d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5addb653-11b8-49d2-ae7a-ae51271adfd7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:39 devstack sudo[106185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5addb653-11b8-49d2-ae7a-ae51271adfd7
Nov 05 15:21:39 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:40 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e3976503-035d-48e9-b541-dcb3e534d91d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5addb653-11b8-49d2-ae7a-ae51271adfd7" returned: 0 in 0.241s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e3976503-035d-48e9-b541-dcb3e534d91d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "cinder-quobyte-5addb653-11b8-49d2-ae7a-ae51271adfd7" released by "delete_volume" :: held 0.637s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:40 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-e3976503-035d-48e9-b541-dcb3e534d91d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Created reservations ['2bfd55eb-05d6-4e66-8e8f-c16316fb059f', '43caa350-5b02-443e-b339-519ec38e0a79', 'd863f581-1c4e-4dbd-8af1-5a5334a19410', '595adbe0-aaa6-493b-a7e3-fef8891178e1'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:21:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e3976503-035d-48e9-b541-dcb3e534d91d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e3976503-035d-48e9-b541-dcb3e534d91d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e3976503-035d-48e9-b541-dcb3e534d91d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:21:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e3976503-035d-48e9-b541-dcb3e534d91d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:21:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e3976503-035d-48e9-b541-dcb3e534d91d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e3976503-035d-48e9-b541-dcb3e534d91d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:40 devstack sudo[106188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:21:40 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:40 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e3976503-035d-48e9-b541-dcb3e534d91d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.250s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:40 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-e3976503-035d-48e9-b541-dcb3e534d91d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:21:40 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e3976503-035d-48e9-b541-dcb3e534d91d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Deleted volume successfully.
Nov 05 15:21:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e3976503-035d-48e9-b541-dcb3e534d91d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "cinder-5addb653-11b8-49d2-ae7a-ae51271adfd7-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0de12fac-1b68-484b-8873-b1168a920943 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "cinder-084cc088-d374-428c-a8f4-fdaf130dc5e9-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0de12fac-1b68-484b-8873-b1168a920943 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "cinder-084cc088-d374-428c-a8f4-fdaf130dc5e9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0de12fac-1b68-484b-8873-b1168a920943 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "cinder-quobyte-084cc088-d374-428c-a8f4-fdaf130dc5e9" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0de12fac-1b68-484b-8873-b1168a920943 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "cinder-quobyte-084cc088-d374-428c-a8f4-fdaf130dc5e9" acquired by "delete_volume" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:40 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4dbd0d-5bc2-47ed-92b2-ba30566a2649]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:21:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0de12fac-1b68-484b-8873-b1168a920943 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-084cc088-d374-428c-a8f4-fdaf130dc5e9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:40 devstack sudo[106191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-084cc088-d374-428c-a8f4-fdaf130dc5e9
Nov 05 15:21:40 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:41 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0de12fac-1b68-484b-8873-b1168a920943 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-084cc088-d374-428c-a8f4-fdaf130dc5e9" returned: 0 in 0.346s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0de12fac-1b68-484b-8873-b1168a920943 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-084cc088-d374-428c-a8f4-fdaf130dc5e9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:41 devstack sudo[106196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-084cc088-d374-428c-a8f4-fdaf130dc5e9
Nov 05 15:21:41 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:41 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0de12fac-1b68-484b-8873-b1168a920943 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-084cc088-d374-428c-a8f4-fdaf130dc5e9" returned: 0 in 0.242s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0de12fac-1b68-484b-8873-b1168a920943 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "cinder-quobyte-084cc088-d374-428c-a8f4-fdaf130dc5e9" released by "delete_volume" :: held 0.630s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:41 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-0de12fac-1b68-484b-8873-b1168a920943 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Created reservations ['5d472145-0eef-41af-8768-cfa5f72b955a', 'da233e28-1472-4eb4-9bc0-61dffec7131e', '9b35c875-a1e0-465e-8ed7-1b97c61f1d24', '5a477dc5-7397-4eef-a8ad-645e432fffc8'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:21:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0de12fac-1b68-484b-8873-b1168a920943 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0de12fac-1b68-484b-8873-b1168a920943 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0de12fac-1b68-484b-8873-b1168a920943 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:21:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0de12fac-1b68-484b-8873-b1168a920943 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:21:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0de12fac-1b68-484b-8873-b1168a920943 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0de12fac-1b68-484b-8873-b1168a920943 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:41 devstack sudo[106199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:21:41 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:41 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0de12fac-1b68-484b-8873-b1168a920943 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.243s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:41 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-0de12fac-1b68-484b-8873-b1168a920943 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:21:41 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0de12fac-1b68-484b-8873-b1168a920943 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Deleted volume successfully.
Nov 05 15:21:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0de12fac-1b68-484b-8873-b1168a920943 tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "cinder-084cc088-d374-428c-a8f4-fdaf130dc5e9-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4acdb7bb-1f5d-47b7-a630-b38b0b71769d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "cinder-3f6f9210-7577-4fd5-8c48-38ffff8ce37c-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4acdb7bb-1f5d-47b7-a630-b38b0b71769d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "cinder-3f6f9210-7577-4fd5-8c48-38ffff8ce37c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4acdb7bb-1f5d-47b7-a630-b38b0b71769d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "cinder-quobyte-3f6f9210-7577-4fd5-8c48-38ffff8ce37c" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4acdb7bb-1f5d-47b7-a630-b38b0b71769d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "cinder-quobyte-3f6f9210-7577-4fd5-8c48-38ffff8ce37c" acquired by "delete_volume" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:41 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[401a1bc2-b18a-4956-a3f3-c7a149dea4a4]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:21:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4acdb7bb-1f5d-47b7-a630-b38b0b71769d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3f6f9210-7577-4fd5-8c48-38ffff8ce37c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:41 devstack sudo[106202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3f6f9210-7577-4fd5-8c48-38ffff8ce37c
Nov 05 15:21:41 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:42 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4acdb7bb-1f5d-47b7-a630-b38b0b71769d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3f6f9210-7577-4fd5-8c48-38ffff8ce37c" returned: 0 in 0.358s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4acdb7bb-1f5d-47b7-a630-b38b0b71769d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3f6f9210-7577-4fd5-8c48-38ffff8ce37c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:42 devstack sudo[106207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3f6f9210-7577-4fd5-8c48-38ffff8ce37c
Nov 05 15:21:42 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:42 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4acdb7bb-1f5d-47b7-a630-b38b0b71769d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-3f6f9210-7577-4fd5-8c48-38ffff8ce37c" returned: 0 in 0.248s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4acdb7bb-1f5d-47b7-a630-b38b0b71769d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "cinder-quobyte-3f6f9210-7577-4fd5-8c48-38ffff8ce37c" released by "delete_volume" :: held 0.645s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:42 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-4acdb7bb-1f5d-47b7-a630-b38b0b71769d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Created reservations ['6609eb59-2928-4c35-bb4c-c1daed671e77', '7a9d9226-7133-4808-8286-b04c9c15d5f8', '6fd115e8-d516-450c-9230-434210ffe342', '982bde18-70df-4111-b24e-2af0676a29eb'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:21:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4acdb7bb-1f5d-47b7-a630-b38b0b71769d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4acdb7bb-1f5d-47b7-a630-b38b0b71769d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4acdb7bb-1f5d-47b7-a630-b38b0b71769d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:21:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4acdb7bb-1f5d-47b7-a630-b38b0b71769d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:21:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4acdb7bb-1f5d-47b7-a630-b38b0b71769d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4acdb7bb-1f5d-47b7-a630-b38b0b71769d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:42 devstack sudo[106210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:21:42 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:42 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4acdb7bb-1f5d-47b7-a630-b38b0b71769d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.242s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:42 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-4acdb7bb-1f5d-47b7-a630-b38b0b71769d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:21:42 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4acdb7bb-1f5d-47b7-a630-b38b0b71769d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Deleted volume successfully.
Nov 05 15:21:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4acdb7bb-1f5d-47b7-a630-b38b0b71769d tempest-CreateVolumesFromSourceVolumeTest-1556508214 None] Lock "cinder-3f6f9210-7577-4fd5-8c48-38ffff8ce37c-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:45 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:21:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Flow 'volume_create_manager' (fe8f10f6-36a0-4984-a4ed-54abd0db8f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:21:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbea5f9b-1590-4eb2-83ba-27a558386922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbea5f9b-1590-4eb2-83ba-27a558386922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-280353589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd43631aab294ec2a9b6b24b15a4e01e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:46Z,use_quota=True,user_id='bff38ad1b18b4cb8a57e39787d12ef4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15fe829e-746a-4bea-8185-5d0c79d313cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15fe829e-746a-4bea-8185-5d0c79d313cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c78c7e53-368d-4eaa-9084-eadeaf2aea2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c78c7e53-368d-4eaa-9084-eadeaf2aea2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2', 'volume_name': 'volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03760d3a-c7e2-4861-b51c-a7019ef6454c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03760d3a-c7e2-4861-b51c-a7019ef6454c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f369d0c-10f3-42f8-99a3-bbe4e5f10cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:45 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Volume b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2', 'volume_size': 1}
Nov 05 15:21:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-280353589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd43631aab294ec2a9b6b24b15a4e01e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:46Z,use_quota=True,user_id='bff38ad1b18b4cb8a57e39787d12ef4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:21:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Creating volume b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:21:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:21:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:21:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:21:45 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:21:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:45 devstack sudo[106214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2 1073741824
Nov 05 15:21:45 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:46 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2 1073741824" returned: 0 in 0.406s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:46 devstack sudo[106219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2
Nov 05 15:21:46 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:46 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2" returned: 0 in 0.251s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:21:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f369d0c-10f3-42f8-99a3-bbe4e5f10cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55de959b-4815-43c0-adf6-627bb7e1b51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:46 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Volume volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2 (b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2): created successfully
Nov 05 15:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55de959b-4815-43c0-adf6-627bb7e1b51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Flow 'volume_create_manager' (fe8f10f6-36a0-4984-a4ed-54abd0db8f85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:21:46 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-315169e6-cb2f-4003-ac6a-712d9c68a695 tempest-VolumeDependencyTests-821315477 None] Created volume successfully.
Nov 05 15:21:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ce1f774e-0eb0-4cab-a3a1-be20b35ad3a6 tempest-VolumeDependencyTests-821315477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ce1f774e-0eb0-4cab-a3a1-be20b35ad3a6 tempest-VolumeDependencyTests-821315477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ce1f774e-0eb0-4cab-a3a1-be20b35ad3a6 tempest-VolumeDependencyTests-821315477 None] Creating offline snapshot 8a1c85fa-9865-4538-9572-adf93e15c0ed of volume b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:21:46 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae438ba-da70-4063-a8ea-b66e363b47fc]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:21:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ce1f774e-0eb0-4cab-a3a1-be20b35ad3a6 tempest-VolumeDependencyTests-821315477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:46 devstack sudo[106222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2
Nov 05 15:21:46 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:47 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ce1f774e-0eb0-4cab-a3a1-be20b35ad3a6 tempest-VolumeDependencyTests-821315477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2" returned: 0 in 0.356s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ce1f774e-0eb0-4cab-a3a1-be20b35ad3a6 tempest-VolumeDependencyTests-821315477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.8a1c85fa-9865-4538-9572-adf93e15c0ed 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:47 devstack sudo[106227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.8a1c85fa-9865-4538-9572-adf93e15c0ed 1G
Nov 05 15:21:47 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:47 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ce1f774e-0eb0-4cab-a3a1-be20b35ad3a6 tempest-VolumeDependencyTests-821315477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.8a1c85fa-9865-4538-9572-adf93e15c0ed 1G" returned: 0 in 0.388s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ce1f774e-0eb0-4cab-a3a1-be20b35ad3a6 tempest-VolumeDependencyTests-821315477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.8a1c85fa-9865-4538-9572-adf93e15c0ed {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:47 devstack sudo[106232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.8a1c85fa-9865-4538-9572-adf93e15c0ed
Nov 05 15:21:47 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:47 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ce1f774e-0eb0-4cab-a3a1-be20b35ad3a6 tempest-VolumeDependencyTests-821315477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.8a1c85fa-9865-4538-9572-adf93e15c0ed" returned: 0 in 0.341s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:47 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-ce1f774e-0eb0-4cab-a3a1-be20b35ad3a6 tempest-VolumeDependencyTests-821315477 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.8a1c85fa-9865-4538-9572-adf93e15c0ed is being set with open permissions: ugo+rw
Nov 05 15:21:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ce1f774e-0eb0-4cab-a3a1-be20b35ad3a6 tempest-VolumeDependencyTests-821315477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.8a1c85fa-9865-4538-9572-adf93e15c0ed {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:47 devstack sudo[106237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.8a1c85fa-9865-4538-9572-adf93e15c0ed
Nov 05 15:21:47 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:48 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ce1f774e-0eb0-4cab-a3a1-be20b35ad3a6 tempest-VolumeDependencyTests-821315477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.8a1c85fa-9865-4538-9572-adf93e15c0ed" returned: 0 in 0.237s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ce1f774e-0eb0-4cab-a3a1-be20b35ad3a6 tempest-VolumeDependencyTests-821315477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:48 devstack sudo[106240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.info
Nov 05 15:21:48 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:48 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ce1f774e-0eb0-4cab-a3a1-be20b35ad3a6 tempest-VolumeDependencyTests-821315477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.info" returned: 0 in 0.245s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:48 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-ce1f774e-0eb0-4cab-a3a1-be20b35ad3a6 tempest-VolumeDependencyTests-821315477 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.info is being set with open permissions: ugo+rw
Nov 05 15:21:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ce1f774e-0eb0-4cab-a3a1-be20b35ad3a6 tempest-VolumeDependencyTests-821315477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:48 devstack sudo[106244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.info
Nov 05 15:21:48 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:48 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ce1f774e-0eb0-4cab-a3a1-be20b35ad3a6 tempest-VolumeDependencyTests-821315477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.info" returned: 0 in 0.233s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ce1f774e-0eb0-4cab-a3a1-be20b35ad3a6 tempest-VolumeDependencyTests-821315477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.910s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:48 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ce1f774e-0eb0-4cab-a3a1-be20b35ad3a6 tempest-VolumeDependencyTests-821315477 None] Create snapshot completed successfully
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Flow 'volume_create_manager' (8e097e3d-3e78-4cc3-8c31-8a2479733447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef7d0c9b-297e-41fc-85a9-2a752d74b10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef7d0c9b-297e-41fc-85a9-2a752d74b10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-744234129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7dfc66c-78b8-413e-8c32-1e39ad60d902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd43631aab294ec2a9b6b24b15a4e01e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8a1c85fa-9865-4538-9572-adf93e15c0ed,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:49Z,use_quota=True,user_id='bff38ad1b18b4cb8a57e39787d12ef4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea1a199-aaae-4c60-a7f3-cfdec55a0b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea1a199-aaae-4c60-a7f3-cfdec55a0b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a85172b9-e23e-45e5-88f5-36ff25698a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a85172b9-e23e-45e5-88f5-36ff25698a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd7dfc66c-78b8-413e-8c32-1e39ad60d902', 'volume_name': 'volume-d7dfc66c-78b8-413e-8c32-1e39ad60d902', 'volume_size': 1, 'snapshot_id': '8a1c85fa-9865-4538-9572-adf93e15c0ed'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (682605aa-c74f-493f-a085-eb39a8fd0ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (682605aa-c74f-493f-a085-eb39a8fd0ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56104210-ebf5-4450-8727-5604fbc54d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:49 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Volume d7dfc66c-78b8-413e-8c32-1e39ad60d902: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d7dfc66c-78b8-413e-8c32-1e39ad60d902', 'volume_size': 1, 'snapshot_id': '8a1c85fa-9865-4538-9572-adf93e15c0ed'}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Acquiring lock "cinder-quobyte-8a1c85fa-9865-4538-9572-adf93e15c0ed-d7dfc66c-78b8-413e-8c32-1e39ad60d902" by "_create_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Lock "cinder-quobyte-8a1c85fa-9865-4538-9572-adf93e15c0ed-d7dfc66c-78b8-413e-8c32-1e39ad60d902" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Creating volume d7dfc66c-78b8-413e-8c32-1e39ad60d902 from snapshot 8a1c85fa-9865-4538-9572-adf93e15c0ed {{(pid=87150) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Acquiring lock "cinder-quobyte-d7dfc66c-78b8-413e-8c32-1e39ad60d902" by "_copy_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Lock "cinder-quobyte-d7dfc66c-78b8-413e-8c32-1e39ad60d902" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] snapshot: 8a1c85fa-9865-4538-9572-adf93e15c0ed, volume: d7dfc66c-78b8-413e-8c32-1e39ad60d902,  {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3578214b-c65e-4dc2-98d6-2ce301abc574]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.8a1c85fa-9865-4538-9572-adf93e15c0ed {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:49 devstack sudo[106248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.8a1c85fa-9865-4538-9572-adf93e15c0ed
Nov 05 15:21:49 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:49 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.8a1c85fa-9865-4538-9572-adf93e15c0ed" returned: 0 in 0.352s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a043128-e9aa-47ec-b6aa-6774e7d7ed00]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:21:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:50 devstack sudo[106253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2
Nov 05 15:21:50 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:50 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2" returned: 0 in 0.343s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2 {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 15:21:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Creating direct copy from snapshot {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 15:21:50 devstack cinder-volume[87150]: DEBUG cinder.utils [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Path /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d7dfc66c-78b8-413e-8c32-1e39ad60d902 not found in is_blk_device check {{(pid=87150) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 15:21:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d7dfc66c-78b8-413e-8c32-1e39ad60d902 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:50 devstack sudo[106258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d7dfc66c-78b8-413e-8c32-1e39ad60d902
Nov 05 15:21:50 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:56 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d7dfc66c-78b8-413e-8c32-1e39ad60d902" returned: 0 in 6.053s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:56 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Image conversion details: src /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d7dfc66c-78b8-413e-8c32-1e39ad60d902 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:21:56 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Converted 1024.00 MB image at 169.14 MB/s
Nov 05 15:21:56 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d7dfc66c-78b8-413e-8c32-1e39ad60d902 is being set with open permissions: ugo+rw
Nov 05 15:21:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d7dfc66c-78b8-413e-8c32-1e39ad60d902 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:56 devstack sudo[106271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d7dfc66c-78b8-413e-8c32-1e39ad60d902
Nov 05 15:21:56 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:56 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d7dfc66c-78b8-413e-8c32-1e39ad60d902" returned: 0 in 0.238s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Lock "cinder-quobyte-d7dfc66c-78b8-413e-8c32-1e39ad60d902" released by "_copy_volume_from_snapshot" :: held 7.064s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Lock "cinder-quobyte-8a1c85fa-9865-4538-9572-adf93e15c0ed-d7dfc66c-78b8-413e-8c32-1e39ad60d902" released by "_create_volume_from_snapshot" :: held 7.124s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.138s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56104210-ebf5-4450-8727-5604fbc54d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7dfc66c-78b8-413e-8c32-1e39ad60d902', 'volume_size': 1, 'snapshot_id': '8a1c85fa-9865-4538-9572-adf93e15c0ed'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3b5d1a-b171-4609-aea5-905ac83bd359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:21:56 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Volume volume-d7dfc66c-78b8-413e-8c32-1e39ad60d902 (d7dfc66c-78b8-413e-8c32-1e39ad60d902): created successfully
Nov 05 15:21:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3b5d1a-b171-4609-aea5-905ac83bd359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:21:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Flow 'volume_create_manager' (8e097e3d-3e78-4cc3-8c31-8a2479733447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:21:56 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6ef66cd5-3f8a-4614-8413-69a6c240a3c0 tempest-VolumeDependencyTests-821315477 None] Created volume successfully.
Nov 05 15:21:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6e78207e-b7dc-41d8-924d-2926b6b727ca tempest-VolumeDependencyTests-821315477 None] Acquiring lock "cinder-8a1c85fa-9865-4538-9572-adf93e15c0ed-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6e78207e-b7dc-41d8-924d-2926b6b727ca tempest-VolumeDependencyTests-821315477 None] Lock "cinder-8a1c85fa-9865-4538-9572-adf93e15c0ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6e78207e-b7dc-41d8-924d-2926b6b727ca tempest-VolumeDependencyTests-821315477 None] Acquiring lock "cinder-quobyte-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6e78207e-b7dc-41d8-924d-2926b6b727ca tempest-VolumeDependencyTests-821315477 None] Lock "cinder-quobyte-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6e78207e-b7dc-41d8-924d-2926b6b727ca tempest-VolumeDependencyTests-821315477 None] Acquiring lock "cinder-quobyte-8a1c85fa-9865-4538-9572-adf93e15c0ed" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6e78207e-b7dc-41d8-924d-2926b6b727ca tempest-VolumeDependencyTests-821315477 None] Lock "cinder-quobyte-8a1c85fa-9865-4538-9572-adf93e15c0ed" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6e78207e-b7dc-41d8-924d-2926b6b727ca tempest-VolumeDependencyTests-821315477 None] Deleting offline snapshot 8a1c85fa-9865-4538-9572-adf93e15c0ed of volume b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:21:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6e78207e-b7dc-41d8-924d-2926b6b727ca tempest-VolumeDependencyTests-821315477 None] snapshot_file for this snap is: volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.8a1c85fa-9865-4538-9572-adf93e15c0ed {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:21:57 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[253980fd-40cc-4ca5-bd3b-a6e5a8d4fa4e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:21:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e78207e-b7dc-41d8-924d-2926b6b727ca tempest-VolumeDependencyTests-821315477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.8a1c85fa-9865-4538-9572-adf93e15c0ed {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:57 devstack sudo[106274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.8a1c85fa-9865-4538-9572-adf93e15c0ed
Nov 05 15:21:57 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:57 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e78207e-b7dc-41d8-924d-2926b6b727ca tempest-VolumeDependencyTests-821315477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.8a1c85fa-9865-4538-9572-adf93e15c0ed" returned: 0 in 0.350s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6e78207e-b7dc-41d8-924d-2926b6b727ca tempest-VolumeDependencyTests-821315477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:21:57 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f96a837-ef3c-422c-af3e-ee69a1edf8db]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:21:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e78207e-b7dc-41d8-924d-2926b6b727ca tempest-VolumeDependencyTests-821315477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:57 devstack sudo[106279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2
Nov 05 15:21:57 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:57 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e78207e-b7dc-41d8-924d-2926b6b727ca tempest-VolumeDependencyTests-821315477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2" returned: 0 in 0.526s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e78207e-b7dc-41d8-924d-2926b6b727ca tempest-VolumeDependencyTests-821315477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.8a1c85fa-9865-4538-9572-adf93e15c0ed {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:57 devstack sudo[106284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.8a1c85fa-9865-4538-9572-adf93e15c0ed
Nov 05 15:21:57 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:58 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e78207e-b7dc-41d8-924d-2926b6b727ca tempest-VolumeDependencyTests-821315477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.8a1c85fa-9865-4538-9572-adf93e15c0ed" returned: 0 in 0.317s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e78207e-b7dc-41d8-924d-2926b6b727ca tempest-VolumeDependencyTests-821315477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.8a1c85fa-9865-4538-9572-adf93e15c0ed {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:58 devstack sudo[106289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.8a1c85fa-9865-4538-9572-adf93e15c0ed
Nov 05 15:21:58 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:58 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6e78207e-b7dc-41d8-924d-2926b6b727ca tempest-VolumeDependencyTests-821315477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2.8a1c85fa-9865-4538-9572-adf93e15c0ed" returned: 0 in 0.250s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6e78207e-b7dc-41d8-924d-2926b6b727ca tempest-VolumeDependencyTests-821315477 None] Lock "cinder-quobyte-8a1c85fa-9865-4538-9572-adf93e15c0ed" released by "_delete_snapshot" :: held 1.543s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6e78207e-b7dc-41d8-924d-2926b6b727ca tempest-VolumeDependencyTests-821315477 None] Lock "cinder-quobyte-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2" released by "delete_snapshot" :: held 1.566s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:58 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-6e78207e-b7dc-41d8-924d-2926b6b727ca tempest-VolumeDependencyTests-821315477 None] Created reservations ['64d077b9-e3c2-4ecf-91b3-593768c6f110', '3799c0de-0bc6-429e-888c-9484d29b856c', '23d90f33-9d69-48b2-8583-67177ff67cba', '3b6bc8a3-f269-4955-8d12-8fbcec220d1a'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:21:58 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6e78207e-b7dc-41d8-924d-2926b6b727ca tempest-VolumeDependencyTests-821315477 None] Delete snapshot completed successfully.
Nov 05 15:21:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6e78207e-b7dc-41d8-924d-2926b6b727ca tempest-VolumeDependencyTests-821315477 None] Lock "cinder-8a1c85fa-9865-4538-9572-adf93e15c0ed-delete_snapshot" released by "delete_snapshot" :: held 1.690s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bd686f73-a934-494a-a39d-33c15af66927 tempest-VolumeDependencyTests-821315477 None] Acquiring lock "cinder-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bd686f73-a934-494a-a39d-33c15af66927 tempest-VolumeDependencyTests-821315477 None] Lock "cinder-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bd686f73-a934-494a-a39d-33c15af66927 tempest-VolumeDependencyTests-821315477 None] Acquiring lock "cinder-quobyte-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:21:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bd686f73-a934-494a-a39d-33c15af66927 tempest-VolumeDependencyTests-821315477 None] Lock "cinder-quobyte-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2" acquired by "delete_volume" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:21:59 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[454e7deb-9c80-46da-a21f-82b73229272c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:21:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bd686f73-a934-494a-a39d-33c15af66927 tempest-VolumeDependencyTests-821315477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:59 devstack sudo[106292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2
Nov 05 15:21:59 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:59 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bd686f73-a934-494a-a39d-33c15af66927 tempest-VolumeDependencyTests-821315477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2" returned: 0 in 0.355s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bd686f73-a934-494a-a39d-33c15af66927 tempest-VolumeDependencyTests-821315477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:59 devstack sudo[106298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2
Nov 05 15:21:59 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:21:59 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root
Nov 05 15:21:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bd686f73-a934-494a-a39d-33c15af66927 tempest-VolumeDependencyTests-821315477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2" returned: 0 in 0.239s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:21:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bd686f73-a934-494a-a39d-33c15af66927 tempest-VolumeDependencyTests-821315477 None] Lock "cinder-quobyte-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2" released by "delete_volume" :: held 0.652s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:21:59 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-bd686f73-a934-494a-a39d-33c15af66927 tempest-VolumeDependencyTests-821315477 None] Created reservations ['02d79e29-f546-4107-8818-e1a137ef9ff5', '55069728-57ca-4f7b-b04c-e8715594434f', '5c5aadb3-f062-4fec-bc5e-9073b3ce9eda', 'dd855991-263b-44e5-876c-48c8c3b22796'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:21:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bd686f73-a934-494a-a39d-33c15af66927 tempest-VolumeDependencyTests-821315477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:21:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bd686f73-a934-494a-a39d-33c15af66927 tempest-VolumeDependencyTests-821315477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:21:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bd686f73-a934-494a-a39d-33c15af66927 tempest-VolumeDependencyTests-821315477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:21:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bd686f73-a934-494a-a39d-33c15af66927 tempest-VolumeDependencyTests-821315477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:21:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bd686f73-a934-494a-a39d-33c15af66927 tempest-VolumeDependencyTests-821315477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:21:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bd686f73-a934-494a-a39d-33c15af66927 tempest-VolumeDependencyTests-821315477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:21:59 devstack sudo[106301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:21:59 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:00 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bd686f73-a934-494a-a39d-33c15af66927 tempest-VolumeDependencyTests-821315477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.237s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:00 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-bd686f73-a934-494a-a39d-33c15af66927 tempest-VolumeDependencyTests-821315477 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:22:00 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-bd686f73-a934-494a-a39d-33c15af66927 tempest-VolumeDependencyTests-821315477 None] Deleted volume successfully.
Nov 05 15:22:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bd686f73-a934-494a-a39d-33c15af66927 tempest-VolumeDependencyTests-821315477 None] Lock "cinder-b76c6a4a-f1c4-40ed-8476-4e0c1b29d9c2-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2b22840b-f5b2-4dc7-a763-59a9d7482b38 tempest-VolumeDependencyTests-821315477 None] Acquiring lock "cinder-d7dfc66c-78b8-413e-8c32-1e39ad60d902-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2b22840b-f5b2-4dc7-a763-59a9d7482b38 tempest-VolumeDependencyTests-821315477 None] Lock "cinder-d7dfc66c-78b8-413e-8c32-1e39ad60d902-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2b22840b-f5b2-4dc7-a763-59a9d7482b38 tempest-VolumeDependencyTests-821315477 None] Acquiring lock "cinder-quobyte-d7dfc66c-78b8-413e-8c32-1e39ad60d902" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2b22840b-f5b2-4dc7-a763-59a9d7482b38 tempest-VolumeDependencyTests-821315477 None] Lock "cinder-quobyte-d7dfc66c-78b8-413e-8c32-1e39ad60d902" acquired by "delete_volume" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:00 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[215de286-e26e-4c71-857d-d759044667cd]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2b22840b-f5b2-4dc7-a763-59a9d7482b38 tempest-VolumeDependencyTests-821315477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d7dfc66c-78b8-413e-8c32-1e39ad60d902 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:00 devstack sudo[106304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d7dfc66c-78b8-413e-8c32-1e39ad60d902
Nov 05 15:22:00 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:00 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2b22840b-f5b2-4dc7-a763-59a9d7482b38 tempest-VolumeDependencyTests-821315477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d7dfc66c-78b8-413e-8c32-1e39ad60d902" returned: 0 in 0.351s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2b22840b-f5b2-4dc7-a763-59a9d7482b38 tempest-VolumeDependencyTests-821315477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d7dfc66c-78b8-413e-8c32-1e39ad60d902 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:00 devstack sudo[106309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d7dfc66c-78b8-413e-8c32-1e39ad60d902
Nov 05 15:22:00 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:00 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2b22840b-f5b2-4dc7-a763-59a9d7482b38 tempest-VolumeDependencyTests-821315477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d7dfc66c-78b8-413e-8c32-1e39ad60d902" returned: 0 in 0.244s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2b22840b-f5b2-4dc7-a763-59a9d7482b38 tempest-VolumeDependencyTests-821315477 None] Lock "cinder-quobyte-d7dfc66c-78b8-413e-8c32-1e39ad60d902" released by "delete_volume" :: held 0.636s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:01 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-2b22840b-f5b2-4dc7-a763-59a9d7482b38 tempest-VolumeDependencyTests-821315477 None] Created reservations ['7796147c-e068-49b2-b607-442fcb1ba85f', '3da3b5e5-058b-4673-8387-030164f21d36', 'cdb8fd77-047f-4273-9e6f-99ab4c80fcd6', 'b72351bb-3782-4e30-bb36-825c6eb61314'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:22:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2b22840b-f5b2-4dc7-a763-59a9d7482b38 tempest-VolumeDependencyTests-821315477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2b22840b-f5b2-4dc7-a763-59a9d7482b38 tempest-VolumeDependencyTests-821315477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2b22840b-f5b2-4dc7-a763-59a9d7482b38 tempest-VolumeDependencyTests-821315477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2b22840b-f5b2-4dc7-a763-59a9d7482b38 tempest-VolumeDependencyTests-821315477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2b22840b-f5b2-4dc7-a763-59a9d7482b38 tempest-VolumeDependencyTests-821315477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2b22840b-f5b2-4dc7-a763-59a9d7482b38 tempest-VolumeDependencyTests-821315477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:01 devstack sudo[106312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:22:01 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:01 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2b22840b-f5b2-4dc7-a763-59a9d7482b38 tempest-VolumeDependencyTests-821315477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.242s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:01 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-2b22840b-f5b2-4dc7-a763-59a9d7482b38 tempest-VolumeDependencyTests-821315477 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:22:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2b22840b-f5b2-4dc7-a763-59a9d7482b38 tempest-VolumeDependencyTests-821315477 None] Deleted volume successfully.
Nov 05 15:22:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2b22840b-f5b2-4dc7-a763-59a9d7482b38 tempest-VolumeDependencyTests-821315477 None] Lock "cinder-d7dfc66c-78b8-413e-8c32-1e39ad60d902-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:06 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:22:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Flow 'volume_create_manager' (58e83871-994d-42b9-a343-618726e62eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6207812d-ac42-4de8-910c-fb5801f887e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6207812d-ac42-4de8-910c-fb5801f887e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a24dbe1a-5aef-4efe-b83b-0a52df2c87a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3d02c9dbee2411ba694fe616773b5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:07Z,use_quota=True,user_id='07bbd755cb314bb4a47196676ef54611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399eb36f-4fae-42af-8a54-7e774e482a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399eb36f-4fae-42af-8a54-7e774e482a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6537727a-72d2-4266-837e-245825640f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:06 devstack cinder-volume[87150]: DEBUG cinder.image.glance [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Creating Keystone auth plugin from conf {{(pid=87150) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 15:22:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6537727a-72d2-4266-837e-245825640f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a24dbe1a-5aef-4efe-b83b-0a52df2c87a1', 'volume_name': 'volume-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1', 'volume_size': 1, 'image_id': '6827358e-fb27-41f4-8bce-98d425969351', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6827358e-fb27-41f4-8bce-98d425969351', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd0cd3c51ff7f8f7b528ab9ac49d57c01', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c3d02c9dbee2411ba694fe616773b5dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '623199a585bbc6f969801b2a97a20a66e1258e85f809ab0c67beb310ffb7284ca273bb0ddd5d223d24826e198bd807b566baaf6ac8133b7e0645aa47825e5f46', 'id': '6827358e-fb27-41f4-8bce-98d425969351', 'created_at': datetime.datetime(2026, 11, 5, 14, 22, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 22, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6827358e-fb27-41f4-8bce-98d425969351/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfad9274710>}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847988af-e5e0-4f7f-9155-1b74fa00e543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847988af-e5e0-4f7f-9155-1b74fa00e543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58948d48-0255-444c-87d2-aabbd81c5a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:06 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Volume a24dbe1a-5aef-4efe-b83b-0a52df2c87a1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1', 'volume_size': 1, 'image_id': '6827358e-fb27-41f4-8bce-98d425969351', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6827358e-fb27-41f4-8bce-98d425969351', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd0cd3c51ff7f8f7b528ab9ac49d57c01', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c3d02c9dbee2411ba694fe616773b5dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '623199a585bbc6f969801b2a97a20a66e1258e85f809ab0c67beb310ffb7284ca273bb0ddd5d223d24826e198bd807b566baaf6ac8133b7e0645aa47825e5f46', 'id': '6827358e-fb27-41f4-8bce-98d425969351', 'created_at': datetime.datetime(2026, 11, 5, 14, 22, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 22, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6827358e-fb27-41f4-8bce-98d425969351/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfad9274710>}
Nov 05 15:22:06 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Trying to clone a24dbe1a-5aef-4efe-b83b-0a52df2c87a1 from image 6827358e-fb27-41f4-8bce-98d425969351 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6827358e-fb27-41f4-8bce-98d425969351', 'metadata': {}}]). {{(pid=87150) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 15:22:07 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 15:22:07 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 15:22:07 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[74198cfe-23ed-46e2-95cb-a797692a4a7a]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:07 devstack sudo[106315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD
Nov 05 15:22:07 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:07 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:07 devstack sudo[106319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD
Nov 05 15:22:07 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:07 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD" returned: 1 in 0.316s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 15:22:07 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Temporary image 6827358e-fb27-41f4-8bce-98d425969351 is fetched for user 07bbd755cb314bb4a47196676ef54611. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 15:22:07 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a9a616-f991-4dd9-9324-f398dec37d55]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:07 devstack sudo[106324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD
Nov 05 15:22:07 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:08 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:08 devstack sudo[106328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD
Nov 05 15:22:08 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:08 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD" returned: 1 in 0.321s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 15:22:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a24dbe1a-5aef-4efe-b83b-0a52df2c87a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3d02c9dbee2411ba694fe616773b5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:07Z,use_quota=True,user_id='07bbd755cb314bb4a47196676ef54611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:22:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Creating volume a24dbe1a-5aef-4efe-b83b-0a52df2c87a1 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:22:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:22:08 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:22:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:08 devstack sudo[106333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1 1073741824
Nov 05 15:22:08 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:08 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1 1073741824" returned: 0 in 0.413s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:08 devstack sudo[106338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1
Nov 05 15:22:08 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:09 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1" returned: 0 in 0.244s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:22:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:09 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Attempting download of 6827358e-fb27-41f4-8bce-98d425969351 ((None, [{'url': 'file:///opt/stack/data/glance/images/6827358e-fb27-41f4-8bce-98d425969351', 'metadata': {}}])) to volume a24dbe1a-5aef-4efe-b83b-0a52df2c87a1. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 15:22:09 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1752d149-2a57-40e3-856b-7985a6a15e39]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6827358e-fb27-41f4-8bce-98d425969351_fnx572em {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:09 devstack sudo[106341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6827358e-fb27-41f4-8bce-98d425969351_fnx572em
Nov 05 15:22:09 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:09 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6827358e-fb27-41f4-8bce-98d425969351_fnx572em" returned: 0 in 0.333s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6827358e-fb27-41f4-8bce-98d425969351_fnx572em {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:09 devstack sudo[106346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6827358e-fb27-41f4-8bce-98d425969351_fnx572em
Nov 05 15:22:09 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:09 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6827358e-fb27-41f4-8bce-98d425969351_fnx572em" returned: 1 in 0.318s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6827358e-fb27-41f4-8bce-98d425969351_fnx572em' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 15:22:09 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a32a010-e519-4170-a037-b1ae42d40dba]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:09 devstack sudo[106350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD
Nov 05 15:22:09 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:10 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD" returned: 0 in 0.310s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:10 devstack sudo[106354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD
Nov 05 15:22:10 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:10 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD" returned: 1 in 0.325s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 15:22:10 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] 6827358e-fb27-41f4-8bce-98d425969351 was raw, converting to qcow2 {{(pid=87150) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 15:22:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:10 devstack sudo[106359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1
Nov 05 15:22:10 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:10 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1" returned: 0 in 0.442s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:10 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6827358e-fb27-41f4-8bce-98d425969351_63r7mj7hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:22:10 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 15:22:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:10 devstack sudo[106365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1 1G
Nov 05 15:22:10 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:11 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1 1G" returned: 0 in 0.298s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:11 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Downloaded image 6827358e-fb27-41f4-8bce-98d425969351 ((None, [{'url': 'file:///opt/stack/data/glance/images/6827358e-fb27-41f4-8bce-98d425969351', 'metadata': {}}])) to volume a24dbe1a-5aef-4efe-b83b-0a52df2c87a1 successfully. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 15:22:11 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Temporary image 6827358e-fb27-41f4-8bce-98d425969351 for user 07bbd755cb314bb4a47196676ef54611 is deleted. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 15:22:11 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Marking volume a24dbe1a-5aef-4efe-b83b-0a52df2c87a1 as bootable. {{(pid=87150) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 15:22:11 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Copying metadata from image 6827358e-fb27-41f4-8bce-98d425969351 to a24dbe1a-5aef-4efe-b83b-0a52df2c87a1. {{(pid=87150) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 15:22:11 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Creating volume glance metadata for volume a24dbe1a-5aef-4efe-b83b-0a52df2c87a1 backed by image 6827358e-fb27-41f4-8bce-98d425969351 with: {'image_id': '6827358e-fb27-41f4-8bce-98d425969351', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd0cd3c51ff7f8f7b528ab9ac49d57c01', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87150) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 15:22:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58948d48-0255-444c-87d2-aabbd81c5a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1', 'volume_size': 1, 'image_id': '6827358e-fb27-41f4-8bce-98d425969351', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6827358e-fb27-41f4-8bce-98d425969351', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd0cd3c51ff7f8f7b528ab9ac49d57c01', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c3d02c9dbee2411ba694fe616773b5dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '623199a585bbc6f969801b2a97a20a66e1258e85f809ab0c67beb310ffb7284ca273bb0ddd5d223d24826e198bd807b566baaf6ac8133b7e0645aa47825e5f46', 'id': '6827358e-fb27-41f4-8bce-98d425969351', 'created_at': datetime.datetime(2026, 11, 5, 14, 22, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 22, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6827358e-fb27-41f4-8bce-98d425969351/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfad9274710>}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0fc6150-6d98-4836-84dd-4096b78985af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:11 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Volume volume-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1 (a24dbe1a-5aef-4efe-b83b-0a52df2c87a1): created successfully
Nov 05 15:22:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0fc6150-6d98-4836-84dd-4096b78985af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Flow 'volume_create_manager' (58e83871-994d-42b9-a343-618726e62eae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:11 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1bccfff9-5f2e-4b03-b846-753669823131 tempest-VolumeImageDependencyTests-1015224531 None] Created volume successfully.
Nov 05 15:22:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a7820fba-91ba-47e5-a8b3-621f0fbf680f tempest-VolumeImageDependencyTests-1015224531 None] Acquiring lock "cinder-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a7820fba-91ba-47e5-a8b3-621f0fbf680f tempest-VolumeImageDependencyTests-1015224531 None] Lock "cinder-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a7820fba-91ba-47e5-a8b3-621f0fbf680f tempest-VolumeImageDependencyTests-1015224531 None] Acquiring lock "cinder-quobyte-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a7820fba-91ba-47e5-a8b3-621f0fbf680f tempest-VolumeImageDependencyTests-1015224531 None] Lock "cinder-quobyte-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1" acquired by "delete_volume" :: waited 0.013s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:12 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[63053d87-c7a1-44a1-9128-676af1962013]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a7820fba-91ba-47e5-a8b3-621f0fbf680f tempest-VolumeImageDependencyTests-1015224531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:12 devstack sudo[106371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1
Nov 05 15:22:12 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:12 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a7820fba-91ba-47e5-a8b3-621f0fbf680f tempest-VolumeImageDependencyTests-1015224531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1" returned: 0 in 0.350s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a7820fba-91ba-47e5-a8b3-621f0fbf680f tempest-VolumeImageDependencyTests-1015224531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:12 devstack sudo[106376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1
Nov 05 15:22:12 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:12 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a7820fba-91ba-47e5-a8b3-621f0fbf680f tempest-VolumeImageDependencyTests-1015224531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1" returned: 0 in 0.238s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a7820fba-91ba-47e5-a8b3-621f0fbf680f tempest-VolumeImageDependencyTests-1015224531 None] Lock "cinder-quobyte-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1" released by "delete_volume" :: held 0.631s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:12 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-a7820fba-91ba-47e5-a8b3-621f0fbf680f tempest-VolumeImageDependencyTests-1015224531 None] Created reservations ['183af764-42fe-4627-8bf1-cba46219855c', 'e1487ad9-e033-438f-aaf5-0387a41f1c03', 'd548a2a4-7b81-4711-97f5-cb5d5720e41f', '78c7ec3c-799c-4765-a319-5a194a4dbea9'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:22:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a7820fba-91ba-47e5-a8b3-621f0fbf680f tempest-VolumeImageDependencyTests-1015224531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a7820fba-91ba-47e5-a8b3-621f0fbf680f tempest-VolumeImageDependencyTests-1015224531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a7820fba-91ba-47e5-a8b3-621f0fbf680f tempest-VolumeImageDependencyTests-1015224531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a7820fba-91ba-47e5-a8b3-621f0fbf680f tempest-VolumeImageDependencyTests-1015224531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a7820fba-91ba-47e5-a8b3-621f0fbf680f tempest-VolumeImageDependencyTests-1015224531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a7820fba-91ba-47e5-a8b3-621f0fbf680f tempest-VolumeImageDependencyTests-1015224531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:12 devstack sudo[106379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:22:12 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:13 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a7820fba-91ba-47e5-a8b3-621f0fbf680f tempest-VolumeImageDependencyTests-1015224531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.236s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:13 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a7820fba-91ba-47e5-a8b3-621f0fbf680f tempest-VolumeImageDependencyTests-1015224531 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:22:13 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a7820fba-91ba-47e5-a8b3-621f0fbf680f tempest-VolumeImageDependencyTests-1015224531 None] Deleted volume successfully.
Nov 05 15:22:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a7820fba-91ba-47e5-a8b3-621f0fbf680f tempest-VolumeImageDependencyTests-1015224531 None] Lock "cinder-a24dbe1a-5aef-4efe-b83b-0a52df2c87a1-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:16 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:22:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Flow 'volume_create_manager' (fb549877-6fff-4e99-acf8-421e65cc1496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db13352-b097-4b1a-9b22-0810b2c5a833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db13352-b097-4b1a-9b22-0810b2c5a833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-86578926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b722b8-45c4-472c-b082-dcd27396b959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66755a0b836c4bd595ffab910cd3f452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:16Z,use_quota=True,user_id='75e55ff3803942abab665e1e3b195b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbfbefad-9443-4db7-84d4-643235b92119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbfbefad-9443-4db7-84d4-643235b92119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51a5dfc-44fb-4696-a2c5-9a730d720fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51a5dfc-44fb-4696-a2c5-9a730d720fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29b722b8-45c4-472c-b082-dcd27396b959', 'volume_name': 'volume-29b722b8-45c4-472c-b082-dcd27396b959', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6376cb-eb96-4274-bd11-d28afaa5776c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6376cb-eb96-4274-bd11-d28afaa5776c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d0632e-a784-43b0-90e1-19122c5ea731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:16 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Volume 29b722b8-45c4-472c-b082-dcd27396b959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29b722b8-45c4-472c-b082-dcd27396b959', 'volume_size': 1}
Nov 05 15:22:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-86578926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b722b8-45c4-472c-b082-dcd27396b959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66755a0b836c4bd595ffab910cd3f452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:16Z,use_quota=True,user_id='75e55ff3803942abab665e1e3b195b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:22:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Creating volume 29b722b8-45c4-472c-b082-dcd27396b959 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:22:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:22:16 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:22:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-29b722b8-45c4-472c-b082-dcd27396b959 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:16 devstack sudo[106383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-29b722b8-45c4-472c-b082-dcd27396b959 1073741824
Nov 05 15:22:16 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:16 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-29b722b8-45c4-472c-b082-dcd27396b959 1073741824" returned: 0 in 0.423s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-29b722b8-45c4-472c-b082-dcd27396b959 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:16 devstack sudo[106389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-29b722b8-45c4-472c-b082-dcd27396b959
Nov 05 15:22:16 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:17 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-29b722b8-45c4-472c-b082-dcd27396b959" returned: 0 in 0.238s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:22:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d0632e-a784-43b0-90e1-19122c5ea731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29b722b8-45c4-472c-b082-dcd27396b959', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17060fbe-fcc2-49d1-b914-6d5f565e8893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:17 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Volume volume-29b722b8-45c4-472c-b082-dcd27396b959 (29b722b8-45c4-472c-b082-dcd27396b959): created successfully
Nov 05 15:22:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17060fbe-fcc2-49d1-b914-6d5f565e8893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Flow 'volume_create_manager' (fb549877-6fff-4e99-acf8-421e65cc1496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:17 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-25a6fc6b-a648-486e-9b4b-86676364aaac tempest-ProjectReaderTests-1065409943 None] Created volume successfully.
Nov 05 15:22:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8a7b5b37-1a52-4222-a688-a75aefa960ac tempest-ProjectReaderTests-1065409943 None] Acquiring lock "cinder-29b722b8-45c4-472c-b082-dcd27396b959-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8a7b5b37-1a52-4222-a688-a75aefa960ac tempest-ProjectReaderTests-1065409943 None] Lock "cinder-29b722b8-45c4-472c-b082-dcd27396b959-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8a7b5b37-1a52-4222-a688-a75aefa960ac tempest-ProjectReaderTests-1065409943 None] Acquiring lock "cinder-quobyte-29b722b8-45c4-472c-b082-dcd27396b959" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8a7b5b37-1a52-4222-a688-a75aefa960ac tempest-ProjectReaderTests-1065409943 None] Lock "cinder-quobyte-29b722b8-45c4-472c-b082-dcd27396b959" acquired by "delete_volume" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:17 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[062774d0-b518-46cc-8fef-fcff952e1989]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8a7b5b37-1a52-4222-a688-a75aefa960ac tempest-ProjectReaderTests-1065409943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-29b722b8-45c4-472c-b082-dcd27396b959 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:17 devstack sudo[106394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-29b722b8-45c4-472c-b082-dcd27396b959
Nov 05 15:22:17 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:18 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8a7b5b37-1a52-4222-a688-a75aefa960ac tempest-ProjectReaderTests-1065409943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-29b722b8-45c4-472c-b082-dcd27396b959" returned: 0 in 0.352s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8a7b5b37-1a52-4222-a688-a75aefa960ac tempest-ProjectReaderTests-1065409943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-29b722b8-45c4-472c-b082-dcd27396b959 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:18 devstack sudo[106399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-29b722b8-45c4-472c-b082-dcd27396b959
Nov 05 15:22:18 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:18 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8a7b5b37-1a52-4222-a688-a75aefa960ac tempest-ProjectReaderTests-1065409943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-29b722b8-45c4-472c-b082-dcd27396b959" returned: 0 in 0.241s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8a7b5b37-1a52-4222-a688-a75aefa960ac tempest-ProjectReaderTests-1065409943 None] Lock "cinder-quobyte-29b722b8-45c4-472c-b082-dcd27396b959" released by "delete_volume" :: held 0.633s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:18 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-8a7b5b37-1a52-4222-a688-a75aefa960ac tempest-ProjectReaderTests-1065409943 None] Created reservations ['c1909560-cf2e-42df-9ba8-42fa2674a9f4', 'f017f9e1-350b-4cb8-8a89-db68dd14fac4', '63be8c23-1324-40c6-9789-e35690ba43b7', '2c108d09-dd5e-4693-b26f-6095ee23d6f5'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:22:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8a7b5b37-1a52-4222-a688-a75aefa960ac tempest-ProjectReaderTests-1065409943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8a7b5b37-1a52-4222-a688-a75aefa960ac tempest-ProjectReaderTests-1065409943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8a7b5b37-1a52-4222-a688-a75aefa960ac tempest-ProjectReaderTests-1065409943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8a7b5b37-1a52-4222-a688-a75aefa960ac tempest-ProjectReaderTests-1065409943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8a7b5b37-1a52-4222-a688-a75aefa960ac tempest-ProjectReaderTests-1065409943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8a7b5b37-1a52-4222-a688-a75aefa960ac tempest-ProjectReaderTests-1065409943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:18 devstack sudo[106402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:22:18 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:18 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8a7b5b37-1a52-4222-a688-a75aefa960ac tempest-ProjectReaderTests-1065409943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.260s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:18 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-8a7b5b37-1a52-4222-a688-a75aefa960ac tempest-ProjectReaderTests-1065409943 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:22:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-8a7b5b37-1a52-4222-a688-a75aefa960ac tempest-ProjectReaderTests-1065409943 None] Deleted volume successfully.
Nov 05 15:22:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8a7b5b37-1a52-4222-a688-a75aefa960ac tempest-ProjectReaderTests-1065409943 None] Lock "cinder-29b722b8-45c4-472c-b082-dcd27396b959-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Flow 'volume_create_manager' (8a7dffa0-0cc8-49b0-ab9e-f57dd04ae43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248a14f7-3341-42a6-bbd3-5d8e3cb2cfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248a14f7-3341-42a6-bbd3-5d8e3cb2cfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1035925020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc1350b2-75ad-4a65-8e20-92374f3f2817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66755a0b836c4bd595ffab910cd3f452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:19Z,use_quota=True,user_id='75e55ff3803942abab665e1e3b195b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad92b48-dfb1-447c-8e17-bf2e7b2f1322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad92b48-dfb1-447c-8e17-bf2e7b2f1322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b854d52a-1a6f-4fa3-a80c-3e3a79b71622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b854d52a-1a6f-4fa3-a80c-3e3a79b71622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc1350b2-75ad-4a65-8e20-92374f3f2817', 'volume_name': 'volume-bc1350b2-75ad-4a65-8e20-92374f3f2817', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e832b4-be55-4b14-b659-c339c40471ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e832b4-be55-4b14-b659-c339c40471ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0a3e25-cb85-46d2-a083-22d5101bdc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:19 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Volume bc1350b2-75ad-4a65-8e20-92374f3f2817: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc1350b2-75ad-4a65-8e20-92374f3f2817', 'volume_size': 1}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1035925020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc1350b2-75ad-4a65-8e20-92374f3f2817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66755a0b836c4bd595ffab910cd3f452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:19Z,use_quota=True,user_id='75e55ff3803942abab665e1e3b195b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Creating volume bc1350b2-75ad-4a65-8e20-92374f3f2817 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:22:19 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-bc1350b2-75ad-4a65-8e20-92374f3f2817 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:19 devstack sudo[106405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-bc1350b2-75ad-4a65-8e20-92374f3f2817 1073741824
Nov 05 15:22:19 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:19 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-bc1350b2-75ad-4a65-8e20-92374f3f2817 1073741824" returned: 0 in 0.403s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-bc1350b2-75ad-4a65-8e20-92374f3f2817 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:19 devstack sudo[106411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-bc1350b2-75ad-4a65-8e20-92374f3f2817
Nov 05 15:22:19 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:19 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-bc1350b2-75ad-4a65-8e20-92374f3f2817" returned: 0 in 0.243s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0a3e25-cb85-46d2-a083-22d5101bdc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc1350b2-75ad-4a65-8e20-92374f3f2817', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39eb81ac-3390-4b96-8fa6-9ac5299a10f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:19 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Volume volume-bc1350b2-75ad-4a65-8e20-92374f3f2817 (bc1350b2-75ad-4a65-8e20-92374f3f2817): created successfully
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39eb81ac-3390-4b96-8fa6-9ac5299a10f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Flow 'volume_create_manager' (8a7dffa0-0cc8-49b0-ab9e-f57dd04ae43c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:19 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-86f12f5e-e8cb-4dcf-9f2d-8311f1b3c7df tempest-ProjectReaderTests-1065409943 None] Created volume successfully.
Nov 05 15:22:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c2716115-7fe0-4655-a1e0-ed869949e7a4 tempest-ProjectReaderTests-1065409943 None] Acquiring lock "cinder-bc1350b2-75ad-4a65-8e20-92374f3f2817-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c2716115-7fe0-4655-a1e0-ed869949e7a4 tempest-ProjectReaderTests-1065409943 None] Lock "cinder-bc1350b2-75ad-4a65-8e20-92374f3f2817-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c2716115-7fe0-4655-a1e0-ed869949e7a4 tempest-ProjectReaderTests-1065409943 None] Acquiring lock "cinder-quobyte-bc1350b2-75ad-4a65-8e20-92374f3f2817" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c2716115-7fe0-4655-a1e0-ed869949e7a4 tempest-ProjectReaderTests-1065409943 None] Lock "cinder-quobyte-bc1350b2-75ad-4a65-8e20-92374f3f2817" acquired by "delete_volume" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:20 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7813382-802a-4921-baf3-d19cfea6aa8e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2716115-7fe0-4655-a1e0-ed869949e7a4 tempest-ProjectReaderTests-1065409943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-bc1350b2-75ad-4a65-8e20-92374f3f2817 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:20 devstack sudo[106414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-bc1350b2-75ad-4a65-8e20-92374f3f2817
Nov 05 15:22:20 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:20 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2716115-7fe0-4655-a1e0-ed869949e7a4 tempest-ProjectReaderTests-1065409943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-bc1350b2-75ad-4a65-8e20-92374f3f2817" returned: 0 in 0.353s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2716115-7fe0-4655-a1e0-ed869949e7a4 tempest-ProjectReaderTests-1065409943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-bc1350b2-75ad-4a65-8e20-92374f3f2817 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:20 devstack sudo[106419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-bc1350b2-75ad-4a65-8e20-92374f3f2817
Nov 05 15:22:20 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:20 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2716115-7fe0-4655-a1e0-ed869949e7a4 tempest-ProjectReaderTests-1065409943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-bc1350b2-75ad-4a65-8e20-92374f3f2817" returned: 0 in 0.243s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c2716115-7fe0-4655-a1e0-ed869949e7a4 tempest-ProjectReaderTests-1065409943 None] Lock "cinder-quobyte-bc1350b2-75ad-4a65-8e20-92374f3f2817" released by "delete_volume" :: held 0.635s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:20 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-c2716115-7fe0-4655-a1e0-ed869949e7a4 tempest-ProjectReaderTests-1065409943 None] Created reservations ['810f49ad-fea9-4920-ae52-10a8968e81a9', '903dc57e-fb04-45f1-b849-efea82cb7b28', 'b8910079-1f15-44b7-af5d-db10ac7ab145', '006eff75-5139-4045-8f46-7be90f8ae367'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c2716115-7fe0-4655-a1e0-ed869949e7a4 tempest-ProjectReaderTests-1065409943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c2716115-7fe0-4655-a1e0-ed869949e7a4 tempest-ProjectReaderTests-1065409943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c2716115-7fe0-4655-a1e0-ed869949e7a4 tempest-ProjectReaderTests-1065409943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c2716115-7fe0-4655-a1e0-ed869949e7a4 tempest-ProjectReaderTests-1065409943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c2716115-7fe0-4655-a1e0-ed869949e7a4 tempest-ProjectReaderTests-1065409943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2716115-7fe0-4655-a1e0-ed869949e7a4 tempest-ProjectReaderTests-1065409943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:21 devstack sudo[106422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:22:21 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:21 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c2716115-7fe0-4655-a1e0-ed869949e7a4 tempest-ProjectReaderTests-1065409943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.240s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-c2716115-7fe0-4655-a1e0-ed869949e7a4 tempest-ProjectReaderTests-1065409943 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:22:21 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c2716115-7fe0-4655-a1e0-ed869949e7a4 tempest-ProjectReaderTests-1065409943 None] Deleted volume successfully.
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c2716115-7fe0-4655-a1e0-ed869949e7a4 tempest-ProjectReaderTests-1065409943 None] Lock "cinder-bc1350b2-75ad-4a65-8e20-92374f3f2817-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Flow 'volume_create_manager' (f986bac8-1ddd-44c6-a300-a4dd7d54551d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b51fa3-2c91-4159-81f0-370ff1c5d75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b51fa3-2c91-4159-81f0-370ff1c5d75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1133745925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d22a676-1705-490a-b7af-194c437c912f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66755a0b836c4bd595ffab910cd3f452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:22Z,use_quota=True,user_id='75e55ff3803942abab665e1e3b195b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d91191-c779-4f9f-b79b-4db8926978f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d91191-c779-4f9f-b79b-4db8926978f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c2ea01e-d652-41cb-bc6f-ebabe6cbaacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c2ea01e-d652-41cb-bc6f-ebabe6cbaacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d22a676-1705-490a-b7af-194c437c912f', 'volume_name': 'volume-4d22a676-1705-490a-b7af-194c437c912f', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82649c1e-a1eb-42f0-97e6-1abcfca3cb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82649c1e-a1eb-42f0-97e6-1abcfca3cb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e2ff1b-46e6-4158-8e67-36d8e83b218f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:21 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Volume 4d22a676-1705-490a-b7af-194c437c912f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d22a676-1705-490a-b7af-194c437c912f', 'volume_size': 1}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1133745925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d22a676-1705-490a-b7af-194c437c912f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66755a0b836c4bd595ffab910cd3f452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:22Z,use_quota=True,user_id='75e55ff3803942abab665e1e3b195b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Creating volume 4d22a676-1705-490a-b7af-194c437c912f {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:22:21 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:22:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4d22a676-1705-490a-b7af-194c437c912f 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:21 devstack sudo[106431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4d22a676-1705-490a-b7af-194c437c912f 1073741824
Nov 05 15:22:21 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:22 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4d22a676-1705-490a-b7af-194c437c912f 1073741824" returned: 0 in 0.393s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4d22a676-1705-490a-b7af-194c437c912f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:22 devstack sudo[106436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4d22a676-1705-490a-b7af-194c437c912f
Nov 05 15:22:22 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:22 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4d22a676-1705-490a-b7af-194c437c912f" returned: 0 in 0.242s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:22:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e2ff1b-46e6-4158-8e67-36d8e83b218f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d22a676-1705-490a-b7af-194c437c912f', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df66ebaf-cf3c-4e77-9667-82320e2c2a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:22 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Volume volume-4d22a676-1705-490a-b7af-194c437c912f (4d22a676-1705-490a-b7af-194c437c912f): created successfully
Nov 05 15:22:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df66ebaf-cf3c-4e77-9667-82320e2c2a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Flow 'volume_create_manager' (f986bac8-1ddd-44c6-a300-a4dd7d54551d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:22 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-73c07735-1cdd-4347-bb6a-11a76c150d0b tempest-ProjectReaderTests-1065409943 None] Created volume successfully.
Nov 05 15:22:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-99bbb387-58e6-4187-9769-b22140a4558c tempest-ProjectReaderTests-1065409943 None] Acquiring lock "cinder-4d22a676-1705-490a-b7af-194c437c912f-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-99bbb387-58e6-4187-9769-b22140a4558c tempest-ProjectReaderTests-1065409943 None] Lock "cinder-4d22a676-1705-490a-b7af-194c437c912f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-99bbb387-58e6-4187-9769-b22140a4558c tempest-ProjectReaderTests-1065409943 None] Acquiring lock "cinder-quobyte-4d22a676-1705-490a-b7af-194c437c912f" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-99bbb387-58e6-4187-9769-b22140a4558c tempest-ProjectReaderTests-1065409943 None] Lock "cinder-quobyte-4d22a676-1705-490a-b7af-194c437c912f" acquired by "delete_volume" :: waited 0.013s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:22 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eab8f26-c188-4af1-910c-52091354757e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-99bbb387-58e6-4187-9769-b22140a4558c tempest-ProjectReaderTests-1065409943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4d22a676-1705-490a-b7af-194c437c912f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:23 devstack sudo[106440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4d22a676-1705-490a-b7af-194c437c912f
Nov 05 15:22:23 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:23 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-99bbb387-58e6-4187-9769-b22140a4558c tempest-ProjectReaderTests-1065409943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4d22a676-1705-490a-b7af-194c437c912f" returned: 0 in 0.355s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-99bbb387-58e6-4187-9769-b22140a4558c tempest-ProjectReaderTests-1065409943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4d22a676-1705-490a-b7af-194c437c912f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:23 devstack sudo[106445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4d22a676-1705-490a-b7af-194c437c912f
Nov 05 15:22:23 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:23 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-99bbb387-58e6-4187-9769-b22140a4558c tempest-ProjectReaderTests-1065409943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4d22a676-1705-490a-b7af-194c437c912f" returned: 0 in 0.237s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-99bbb387-58e6-4187-9769-b22140a4558c tempest-ProjectReaderTests-1065409943 None] Lock "cinder-quobyte-4d22a676-1705-490a-b7af-194c437c912f" released by "delete_volume" :: held 0.632s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:23 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-99bbb387-58e6-4187-9769-b22140a4558c tempest-ProjectReaderTests-1065409943 None] Created reservations ['c7b8f3b8-e24c-4127-917a-923f6d78aa0e', '554c845f-dda6-4d4d-bc16-1e121ba68a8e', '5b6a335c-399f-4089-97a7-e7cf374b4a50', '50cceeb4-c306-44b3-8cf9-3c2b9c749465'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:22:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-99bbb387-58e6-4187-9769-b22140a4558c tempest-ProjectReaderTests-1065409943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-99bbb387-58e6-4187-9769-b22140a4558c tempest-ProjectReaderTests-1065409943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-99bbb387-58e6-4187-9769-b22140a4558c tempest-ProjectReaderTests-1065409943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-99bbb387-58e6-4187-9769-b22140a4558c tempest-ProjectReaderTests-1065409943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-99bbb387-58e6-4187-9769-b22140a4558c tempest-ProjectReaderTests-1065409943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-99bbb387-58e6-4187-9769-b22140a4558c tempest-ProjectReaderTests-1065409943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:23 devstack sudo[106448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:22:23 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:23 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-99bbb387-58e6-4187-9769-b22140a4558c tempest-ProjectReaderTests-1065409943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.234s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:23 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-99bbb387-58e6-4187-9769-b22140a4558c tempest-ProjectReaderTests-1065409943 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:22:23 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-99bbb387-58e6-4187-9769-b22140a4558c tempest-ProjectReaderTests-1065409943 None] Deleted volume successfully.
Nov 05 15:22:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-99bbb387-58e6-4187-9769-b22140a4558c tempest-ProjectReaderTests-1065409943 None] Lock "cinder-4d22a676-1705-490a-b7af-194c437c912f-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:24 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:22:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Flow 'volume_create_manager' (9fc06e8a-7d59-44ab-ad71-e2fe478fe7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfba42e6-41cf-48f6-81bb-f7165ccd70de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfba42e6-41cf-48f6-81bb-f7165ccd70de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1510041627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0275f86-a67b-4d3b-8d9a-eab07e5eb435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66755a0b836c4bd595ffab910cd3f452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:24Z,use_quota=True,user_id='75e55ff3803942abab665e1e3b195b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0450030d-6fd4-48b1-8c6c-cc341c60502b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0450030d-6fd4-48b1-8c6c-cc341c60502b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6042dc57-b17a-4a17-88a9-6eba0804555c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6042dc57-b17a-4a17-88a9-6eba0804555c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0275f86-a67b-4d3b-8d9a-eab07e5eb435', 'volume_name': 'volume-a0275f86-a67b-4d3b-8d9a-eab07e5eb435', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9740882-b425-42e0-85aa-2ea7fedcb4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9740882-b425-42e0-85aa-2ea7fedcb4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619b36da-b55b-4172-8c7c-7deddc4ac891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:24 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Volume a0275f86-a67b-4d3b-8d9a-eab07e5eb435: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0275f86-a67b-4d3b-8d9a-eab07e5eb435', 'volume_size': 1}
Nov 05 15:22:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1510041627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0275f86-a67b-4d3b-8d9a-eab07e5eb435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66755a0b836c4bd595ffab910cd3f452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:24Z,use_quota=True,user_id='75e55ff3803942abab665e1e3b195b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:22:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Creating volume a0275f86-a67b-4d3b-8d9a-eab07e5eb435 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:22:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:22:24 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:22:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a0275f86-a67b-4d3b-8d9a-eab07e5eb435 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:24 devstack sudo[106451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a0275f86-a67b-4d3b-8d9a-eab07e5eb435 1073741824
Nov 05 15:22:24 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:24 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a0275f86-a67b-4d3b-8d9a-eab07e5eb435 1073741824" returned: 0 in 0.399s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a0275f86-a67b-4d3b-8d9a-eab07e5eb435 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:24 devstack sudo[106456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a0275f86-a67b-4d3b-8d9a-eab07e5eb435
Nov 05 15:22:24 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:25 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a0275f86-a67b-4d3b-8d9a-eab07e5eb435" returned: 0 in 0.252s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:22:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619b36da-b55b-4172-8c7c-7deddc4ac891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0275f86-a67b-4d3b-8d9a-eab07e5eb435', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985c57f1-6f9b-494f-b0bf-2448c2574085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:25 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Volume volume-a0275f86-a67b-4d3b-8d9a-eab07e5eb435 (a0275f86-a67b-4d3b-8d9a-eab07e5eb435): created successfully
Nov 05 15:22:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985c57f1-6f9b-494f-b0bf-2448c2574085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Flow 'volume_create_manager' (9fc06e8a-7d59-44ab-ad71-e2fe478fe7c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:25 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6dc371b6-c214-481b-a47d-f3f5232266e7 tempest-ProjectReaderTests-1065409943 None] Created volume successfully.
Nov 05 15:22:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1f5bdfc8-75a0-4f39-b4bf-e9251e90d5e2 tempest-ProjectReaderTests-1065409943 None] Acquiring lock "cinder-a0275f86-a67b-4d3b-8d9a-eab07e5eb435-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1f5bdfc8-75a0-4f39-b4bf-e9251e90d5e2 tempest-ProjectReaderTests-1065409943 None] Lock "cinder-a0275f86-a67b-4d3b-8d9a-eab07e5eb435-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:25 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=92,cinder:UPDATE=148,cinder:INSERT=39,cinder:DELETE=18 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:22:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1f5bdfc8-75a0-4f39-b4bf-e9251e90d5e2 tempest-ProjectReaderTests-1065409943 None] Acquiring lock "cinder-quobyte-a0275f86-a67b-4d3b-8d9a-eab07e5eb435" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1f5bdfc8-75a0-4f39-b4bf-e9251e90d5e2 tempest-ProjectReaderTests-1065409943 None] Lock "cinder-quobyte-a0275f86-a67b-4d3b-8d9a-eab07e5eb435" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:25 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[823adfe2-8910-4999-8523-cbaab85e4c63]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1f5bdfc8-75a0-4f39-b4bf-e9251e90d5e2 tempest-ProjectReaderTests-1065409943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a0275f86-a67b-4d3b-8d9a-eab07e5eb435 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:25 devstack sudo[106495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a0275f86-a67b-4d3b-8d9a-eab07e5eb435
Nov 05 15:22:25 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:25 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1f5bdfc8-75a0-4f39-b4bf-e9251e90d5e2 tempest-ProjectReaderTests-1065409943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a0275f86-a67b-4d3b-8d9a-eab07e5eb435" returned: 0 in 0.370s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1f5bdfc8-75a0-4f39-b4bf-e9251e90d5e2 tempest-ProjectReaderTests-1065409943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a0275f86-a67b-4d3b-8d9a-eab07e5eb435 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:25 devstack sudo[106500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a0275f86-a67b-4d3b-8d9a-eab07e5eb435
Nov 05 15:22:25 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:26 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1f5bdfc8-75a0-4f39-b4bf-e9251e90d5e2 tempest-ProjectReaderTests-1065409943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a0275f86-a67b-4d3b-8d9a-eab07e5eb435" returned: 0 in 0.243s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1f5bdfc8-75a0-4f39-b4bf-e9251e90d5e2 tempest-ProjectReaderTests-1065409943 None] Lock "cinder-quobyte-a0275f86-a67b-4d3b-8d9a-eab07e5eb435" released by "delete_volume" :: held 0.650s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:26 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=115,cinder:UPDATE=140,cinder:INSERT=36,cinder:DELETE=8 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:22:26 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-1f5bdfc8-75a0-4f39-b4bf-e9251e90d5e2 tempest-ProjectReaderTests-1065409943 None] Created reservations ['54217e80-d003-402c-92aa-2038e09452e2', 'ba4b8fde-c89a-47fa-996e-49ca2791bc68', '0f7e6ac7-a62e-4395-a4ae-55a18a10371c', '33993b46-6b1a-4cbb-9693-b61f8f8f6556'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:22:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1f5bdfc8-75a0-4f39-b4bf-e9251e90d5e2 tempest-ProjectReaderTests-1065409943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1f5bdfc8-75a0-4f39-b4bf-e9251e90d5e2 tempest-ProjectReaderTests-1065409943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1f5bdfc8-75a0-4f39-b4bf-e9251e90d5e2 tempest-ProjectReaderTests-1065409943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1f5bdfc8-75a0-4f39-b4bf-e9251e90d5e2 tempest-ProjectReaderTests-1065409943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1f5bdfc8-75a0-4f39-b4bf-e9251e90d5e2 tempest-ProjectReaderTests-1065409943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1f5bdfc8-75a0-4f39-b4bf-e9251e90d5e2 tempest-ProjectReaderTests-1065409943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:26 devstack sudo[106503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:22:26 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:26 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1f5bdfc8-75a0-4f39-b4bf-e9251e90d5e2 tempest-ProjectReaderTests-1065409943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.239s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:26 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-1f5bdfc8-75a0-4f39-b4bf-e9251e90d5e2 tempest-ProjectReaderTests-1065409943 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:22:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1f5bdfc8-75a0-4f39-b4bf-e9251e90d5e2 tempest-ProjectReaderTests-1065409943 None] Deleted volume successfully.
Nov 05 15:22:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1f5bdfc8-75a0-4f39-b4bf-e9251e90d5e2 tempest-ProjectReaderTests-1065409943 None] Lock "cinder-a0275f86-a67b-4d3b-8d9a-eab07e5eb435-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:36 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=8 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:22:36 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:INSERT=1,cinder:UPDATE=8,cinder:SELECT=2,cinder:DELETE=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:22:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:22:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:37 devstack sudo[106545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:22:37 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:37 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.286s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:22:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:22:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 15:22:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread info: [<_MainThread(MainThread, started 136317437956224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136317326340928)>, <Thread(Thread-3 (stat_writer), started daemon 136317326487936)>, <Thread(Rabbit-heartbeat, started daemon 136317321464000)>, <Thread(Thread-5 (_runner), started daemon 136317321550592)>, <Thread(Thread-7 (_runner), started daemon 136317321658496)>, <Thread(fd_logger, started daemon 136317319612992)>, <Thread(privsep_reader, started daemon 136317319622400)>, <Thread(tpool_thread_0, started daemon 136317310928576)>, <Thread(tpool_thread_1, started daemon 136317302535872)>, <Thread(tpool_thread_2, started daemon 136317294143168)>, <Thread(tpool_thread_3, started daemon 136317285750464)>, <Thread(tpool_thread_4, started daemon 136317277357760)>, <Thread(tpool_thread_5, started daemon 136317268965056)>, <Thread(tpool_thread_6, started daemon 136317260572352)>, <Thread(tpool_thread_7, started daemon 136317252179648)>, <Thread(tpool_thread_8, started daemon 136317243786944)>, <Thread(tpool_thread_9, started daemon 136317235394240)>, <Thread(tpool_thread_10, started daemon 136317227001536)>, <Thread(tpool_thread_11, started daemon 136317218608832)>, <Thread(tpool_thread_12, started daemon 136317210216128)>, <Thread(tpool_thread_13, started daemon 136317201807040)>, <Thread(tpool_thread_14, started daemon 136317193397952)>, <Thread(tpool_thread_15, started daemon 136317184988864)>, <Thread(tpool_thread_16, started daemon 136317176579776)>, <Thread(tpool_thread_17, started daemon 136317168170688)>, <Thread(tpool_thread_18, started daemon 136317159761600)>, <Thread(tpool_thread_19, started daemon 136317151352512)>] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Flow 'volume_create_manager' (fffb23cb-4124-418c-a06a-9105434525c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (659e1547-b9c9-4ba7-b601-84839294627b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (659e1547-b9c9-4ba7-b601-84839294627b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1295773971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463bed9e-f856-4458-9771-1aae42a44d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6650fb51c93442aabb67a352e2c33c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:38Z,use_quota=True,user_id='c685bc925346489abf626dd40b6339b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042b477e-99c5-4749-b43b-f218cd4a9115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042b477e-99c5-4749-b43b-f218cd4a9115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d4ca15-01ae-4a70-bdf1-15b0f228e08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d4ca15-01ae-4a70-bdf1-15b0f228e08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '463bed9e-f856-4458-9771-1aae42a44d6f', 'volume_name': 'volume-463bed9e-f856-4458-9771-1aae42a44d6f', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6254a61d-5df7-4acb-82dc-56afcc4c2b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6254a61d-5df7-4acb-82dc-56afcc4c2b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47cbcc6c-2806-44f0-9de6-667b336b2659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:38 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Volume 463bed9e-f856-4458-9771-1aae42a44d6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-463bed9e-f856-4458-9771-1aae42a44d6f', 'volume_size': 1}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1295773971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463bed9e-f856-4458-9771-1aae42a44d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6650fb51c93442aabb67a352e2c33c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:38Z,use_quota=True,user_id='c685bc925346489abf626dd40b6339b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Creating volume 463bed9e-f856-4458-9771-1aae42a44d6f {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:22:38 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:38 devstack sudo[106548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f 1073741824
Nov 05 15:22:38 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Flow 'volume_create_manager' (f6ab40c8-22ad-481f-8dbf-884238358877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a341b2-cefd-4b1b-be35-2818a2dbd9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a341b2-cefd-4b1b-be35-2818a2dbd9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-899161309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77f59b9-a134-4b59-8e29-ee9beec2b669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb87d54af6a467383b64171af82dca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:39Z,use_quota=True,user_id='be1f2a9942ba401d924f55f250f2aa8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b0761bd-cbe1-4b74-a53b-74af3165e33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b0761bd-cbe1-4b74-a53b-74af3165e33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc44b9b4-cb61-426c-9295-7a8b272decb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc44b9b4-cb61-426c-9295-7a8b272decb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c77f59b9-a134-4b59-8e29-ee9beec2b669', 'volume_name': 'volume-c77f59b9-a134-4b59-8e29-ee9beec2b669', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c85006-3320-45ec-b45a-fd5f4cb3c263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c85006-3320-45ec-b45a-fd5f4cb3c263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ff6188-b348-4c63-860d-4c2117a275dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:38 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Volume c77f59b9-a134-4b59-8e29-ee9beec2b669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c77f59b9-a134-4b59-8e29-ee9beec2b669', 'volume_size': 1}
Nov 05 15:22:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:39 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f 1073741824" returned: 0 in 0.571s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:22:39 devstack sudo[106554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f
Nov 05 15:22:39 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Flow 'volume_create_manager' (0fab3188-105a-4738-8dba-c2f04cccf1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39190ba-236e-4925-b3a3-6ce281413418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39190ba-236e-4925-b3a3-6ce281413418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-415036752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329159af-f802-41dc-b385-9400ab3c1644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb87d54af6a467383b64171af82dca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:39Z,use_quota=True,user_id='be1f2a9942ba401d924f55f250f2aa8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05eae35-1652-4479-8040-3936dcbe2f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05eae35-1652-4479-8040-3936dcbe2f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd3ec25-41da-48d2-92ec-9599b2f52851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd3ec25-41da-48d2-92ec-9599b2f52851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '329159af-f802-41dc-b385-9400ab3c1644', 'volume_name': 'volume-329159af-f802-41dc-b385-9400ab3c1644', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6275d23c-612f-4ca9-9c32-f2e4d560193d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6275d23c-612f-4ca9-9c32-f2e4d560193d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (131cbe78-1af4-4683-8cbb-7a22b170f6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:39 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Volume 329159af-f802-41dc-b385-9400ab3c1644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-329159af-f802-41dc-b385-9400ab3c1644', 'volume_size': 1}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:39 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f" returned: 0 in 0.585s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.871s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-899161309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77f59b9-a134-4b59-8e29-ee9beec2b669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb87d54af6a467383b64171af82dca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:39Z,use_quota=True,user_id='be1f2a9942ba401d924f55f250f2aa8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Creating volume c77f59b9-a134-4b59-8e29-ee9beec2b669 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:22:39 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c77f59b9-a134-4b59-8e29-ee9beec2b669 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47cbcc6c-2806-44f0-9de6-667b336b2659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-463bed9e-f856-4458-9771-1aae42a44d6f', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:39 devstack sudo[106559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c77f59b9-a134-4b59-8e29-ee9beec2b669 1073741824
Nov 05 15:22:39 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb147b9-6ab8-4255-973b-272dc23aa9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:39 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Volume volume-463bed9e-f856-4458-9771-1aae42a44d6f (463bed9e-f856-4458-9771-1aae42a44d6f): created successfully
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb147b9-6ab8-4255-973b-272dc23aa9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Flow 'volume_create_manager' (fffb23cb-4124-418c-a06a-9105434525c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:40 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3a4268a8-acb3-4fe5-be68-4263f27a1605 tempest-VolumeDependencyTests-651483409 None] Created volume successfully.
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Flow 'volume_create_manager' (af5ca31c-6a24-4afc-bbab-7e12b20bb3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4311565a-b08e-411b-86b8-45462c84091e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4311565a-b08e-411b-86b8-45462c84091e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1063614707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8930ae8-2688-4111-8373-595472533243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9e03f4a164bf48042da27edfd742d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:40Z,use_quota=True,user_id='d3585054b64542a1a174061b1731d371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52edcdca-09f3-40e7-aa56-7a43394fa07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52edcdca-09f3-40e7-aa56-7a43394fa07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d64c67-9e91-4a07-86b6-43f1ffe09ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d64c67-9e91-4a07-86b6-43f1ffe09ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8930ae8-2688-4111-8373-595472533243', 'volume_name': 'volume-a8930ae8-2688-4111-8373-595472533243', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e219a835-3e97-4568-8e31-2c2f36c4462c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e219a835-3e97-4568-8e31-2c2f36c4462c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b27c35-3e3e-411a-aeab-ddda9926b0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:40 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Volume a8930ae8-2688-4111-8373-595472533243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8930ae8-2688-4111-8373-595472533243', 'volume_size': 1}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Flow 'volume_create_manager' (e34effc0-9753-4107-9f03-4a379a30681e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4962c950-c113-4d7d-825f-1161f27d655a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4962c950-c113-4d7d-825f-1161f27d655a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-388967240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b42c7e-7532-4ebb-afa0-2f05f6fa7d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb87d54af6a467383b64171af82dca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:40Z,use_quota=True,user_id='be1f2a9942ba401d924f55f250f2aa8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1379090a-ebc6-4c6e-b8a5-8c7492d72cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1379090a-ebc6-4c6e-b8a5-8c7492d72cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (438f097d-220d-4595-9766-e2ee3a528ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (438f097d-220d-4595-9766-e2ee3a528ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81b42c7e-7532-4ebb-afa0-2f05f6fa7d00', 'volume_name': 'volume-81b42c7e-7532-4ebb-afa0-2f05f6fa7d00', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c936ce-b228-4db1-ba47-678b7e705dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c936ce-b228-4db1-ba47-678b7e705dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bd2ada-dccd-405a-8259-57cb79ef6a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:40 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Volume 81b42c7e-7532-4ebb-afa0-2f05f6fa7d00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81b42c7e-7532-4ebb-afa0-2f05f6fa7d00', 'volume_size': 1}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:40 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c77f59b9-a134-4b59-8e29-ee9beec2b669 1073741824" returned: 0 in 0.666s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c77f59b9-a134-4b59-8e29-ee9beec2b669 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:22:40 devstack sudo[106565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c77f59b9-a134-4b59-8e29-ee9beec2b669
Nov 05 15:22:40 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Flow 'volume_create_manager' (adf0dbbd-6f2e-41fa-8e4a-6515cb7c0ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c082f4-c34a-453f-b235-18a4b38afc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c082f4-c34a-453f-b235-18a4b38afc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1804172296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1272a130-fc14-4e9d-bd8b-cc265700aa71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb87d54af6a467383b64171af82dca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:41Z,use_quota=True,user_id='be1f2a9942ba401d924f55f250f2aa8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74feb3e7-e056-4542-8e16-dc6a9fd3e329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74feb3e7-e056-4542-8e16-dc6a9fd3e329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09ddf0b-fe41-4467-ab92-61e9c2b6860e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09ddf0b-fe41-4467-ab92-61e9c2b6860e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1272a130-fc14-4e9d-bd8b-cc265700aa71', 'volume_name': 'volume-1272a130-fc14-4e9d-bd8b-cc265700aa71', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23acc11-d5f4-4f8c-a2ea-65a9810c4cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23acc11-d5f4-4f8c-a2ea-65a9810c4cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be9ae2e6-67a9-46cb-bdf9-858ebfe5834c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:40 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Volume 1272a130-fc14-4e9d-bd8b-cc265700aa71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1272a130-fc14-4e9d-bd8b-cc265700aa71', 'volume_size': 1}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:40 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c77f59b9-a134-4b59-8e29-ee9beec2b669" returned: 0 in 0.371s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.453s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-415036752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329159af-f802-41dc-b385-9400ab3c1644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb87d54af6a467383b64171af82dca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:39Z,use_quota=True,user_id='be1f2a9942ba401d924f55f250f2aa8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Creating volume 329159af-f802-41dc-b385-9400ab3c1644 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:22:40 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-329159af-f802-41dc-b385-9400ab3c1644 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ff6188-b348-4c63-860d-4c2117a275dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c77f59b9-a134-4b59-8e29-ee9beec2b669', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e5d01d-d88d-463c-b8df-189568642e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:40 devstack sudo[106568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-329159af-f802-41dc-b385-9400ab3c1644 1073741824
Nov 05 15:22:41 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:41 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Volume volume-c77f59b9-a134-4b59-8e29-ee9beec2b669 (c77f59b9-a134-4b59-8e29-ee9beec2b669): created successfully
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e5d01d-d88d-463c-b8df-189568642e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Flow 'volume_create_manager' (f6ab40c8-22ad-481f-8dbf-884238358877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:41 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2c141ada-9a56-4633-89c6-8c4e906ad1f8 tempest-CreateVolumesFromImageTest-187754023 None] Created volume successfully.
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-47320f31-8e29-4b2f-b459-a05ff5db3389 tempest-VolumeDependencyTests-651483409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Flow 'volume_create_manager' (d2e28fca-44ab-4cc5-a176-7fc7201d2f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab715b2-79d2-4511-8587-d9dab0dada4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab715b2-79d2-4511-8587-d9dab0dada4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1880338489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d60281-0b66-42b8-bfb0-25e92d00b26c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb87d54af6a467383b64171af82dca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:41Z,use_quota=True,user_id='be1f2a9942ba401d924f55f250f2aa8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca18db3e-027a-4098-aaf2-61e462fff2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca18db3e-027a-4098-aaf2-61e462fff2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d33642e-7852-4607-97fd-9da2a7529f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d33642e-7852-4607-97fd-9da2a7529f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90d60281-0b66-42b8-bfb0-25e92d00b26c', 'volume_name': 'volume-90d60281-0b66-42b8-bfb0-25e92d00b26c', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aeecfde-216d-4261-bff4-8a7ed0138755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aeecfde-216d-4261-bff4-8a7ed0138755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0120baee-9b73-4110-8508-18760932ce20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:41 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Volume 90d60281-0b66-42b8-bfb0-25e92d00b26c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90d60281-0b66-42b8-bfb0-25e92d00b26c', 'volume_size': 1}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:41 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-329159af-f802-41dc-b385-9400ab3c1644 1073741824" returned: 0 in 0.502s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-329159af-f802-41dc-b385-9400ab3c1644 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:41 devstack sudo[106575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-329159af-f802-41dc-b385-9400ab3c1644
Nov 05 15:22:41 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:41 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-329159af-f802-41dc-b385-9400ab3c1644" returned: 0 in 0.250s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.558s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1063614707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8930ae8-2688-4111-8373-595472533243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9e03f4a164bf48042da27edfd742d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:40Z,use_quota=True,user_id='d3585054b64542a1a174061b1731d371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Creating volume a8930ae8-2688-4111-8373-595472533243 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:22:41 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (131cbe78-1af4-4683-8cbb-7a22b170f6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-329159af-f802-41dc-b385-9400ab3c1644', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:41 devstack sudo[106578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243 1073741824
Nov 05 15:22:41 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6993aaa2-a0dc-40e6-8f5f-2224b806aa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:41 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Volume volume-329159af-f802-41dc-b385-9400ab3c1644 (329159af-f802-41dc-b385-9400ab3c1644): created successfully
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6993aaa2-a0dc-40e6-8f5f-2224b806aa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Flow 'volume_create_manager' (0fab3188-105a-4738-8dba-c2f04cccf1b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:41 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d1e1f704-9295-4e08-86b9-f105cb2ba823 tempest-CreateVolumesFromImageTest-187754023 None] Created volume successfully.
Nov 05 15:22:42 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243 1073741824" returned: 0 in 0.511s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:42 devstack sudo[106584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243
Nov 05 15:22:42 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:42 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243" returned: 0 in 0.257s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:22:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.236s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-388967240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b42c7e-7532-4ebb-afa0-2f05f6fa7d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb87d54af6a467383b64171af82dca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:40Z,use_quota=True,user_id='be1f2a9942ba401d924f55f250f2aa8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:22:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Creating volume 81b42c7e-7532-4ebb-afa0-2f05f6fa7d00 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:22:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:22:42 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:22:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-81b42c7e-7532-4ebb-afa0-2f05f6fa7d00 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b27c35-3e3e-411a-aeab-ddda9926b0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8930ae8-2688-4111-8373-595472533243', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:42 devstack sudo[106587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-81b42c7e-7532-4ebb-afa0-2f05f6fa7d00 1073741824
Nov 05 15:22:42 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea600b2-c95e-4d60-8e2f-a871aa81454e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:42 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Volume volume-a8930ae8-2688-4111-8373-595472533243 (a8930ae8-2688-4111-8373-595472533243): created successfully
Nov 05 15:22:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea600b2-c95e-4d60-8e2f-a871aa81454e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Flow 'volume_create_manager' (af5ca31c-6a24-4afc-bbab-7e12b20bb3b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:42 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-103801a9-a89d-4d6c-ae7c-734c86fca284 tempest-ProjectMemberTests-340429542 None] Created volume successfully.
Nov 05 15:22:43 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-81b42c7e-7532-4ebb-afa0-2f05f6fa7d00 1073741824" returned: 0 in 0.454s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-81b42c7e-7532-4ebb-afa0-2f05f6fa7d00 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:43 devstack sudo[106593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-81b42c7e-7532-4ebb-afa0-2f05f6fa7d00
Nov 05 15:22:43 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Flow 'volume_create_manager' (09ff05e2-4259-4b42-b382-69bf9f0b9975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4efca971-db86-4830-887e-43feb65400dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4efca971-db86-4830-887e-43feb65400dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d23ba4a-b288-4d38-a7b0-8de97ee962d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='519be31ac0484d0a8907c0e22f583e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:43Z,use_quota=True,user_id='562a045b58f04071a9f67e152c049122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ca428a-6a9d-4aa9-964b-7a92d3267941),volume_type_id=11ca428a-6a9d-4aa9-964b-7a92d3267941)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f4d12b-bfbc-4a3d-87c8-95a48c981840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f4d12b-bfbc-4a3d-87c8-95a48c981840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a80332e-9bac-413c-9026-1b55c2418217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG cinder.image.glance [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Creating Keystone auth plugin from conf {{(pid=87150) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 15:22:43 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-81b42c7e-7532-4ebb-afa0-2f05f6fa7d00" returned: 0 in 0.305s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.487s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1804172296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1272a130-fc14-4e9d-bd8b-cc265700aa71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb87d54af6a467383b64171af82dca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:41Z,use_quota=True,user_id='be1f2a9942ba401d924f55f250f2aa8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Creating volume 1272a130-fc14-4e9d-bd8b-cc265700aa71 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:22:43 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1272a130-fc14-4e9d-bd8b-cc265700aa71 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bd2ada-dccd-405a-8259-57cb79ef6a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81b42c7e-7532-4ebb-afa0-2f05f6fa7d00', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:43 devstack sudo[106596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1272a130-fc14-4e9d-bd8b-cc265700aa71 1073741824
Nov 05 15:22:43 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d62efe0-151c-4032-baf6-b99247f32937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:43 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Volume volume-81b42c7e-7532-4ebb-afa0-2f05f6fa7d00 (81b42c7e-7532-4ebb-afa0-2f05f6fa7d00): created successfully
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d62efe0-151c-4032-baf6-b99247f32937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Flow 'volume_create_manager' (e34effc0-9753-4107-9f03-4a379a30681e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:43 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2995c3ff-9d4b-4d5a-b286-f59d4f8fcaed tempest-CreateVolumesFromImageTest-187754023 None] Created volume successfully.
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e6ecfdb7-6a77-4cc2-be50-1956b843b98e tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a80332e-9bac-413c-9026-1b55c2418217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6d23ba4a-b288-4d38-a7b0-8de97ee962d7', 'volume_name': 'volume-6d23ba4a-b288-4d38-a7b0-8de97ee962d7', 'volume_size': 1, 'image_id': '1273cfb8-3cea-46b3-b441-36223065ce39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1273cfb8-3cea-46b3-b441-36223065ce39', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '17ce33b9b589782fe0e9c6c62a59aff3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '519be31ac0484d0a8907c0e22f583e84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '136dc18fdefc77fa214e6ad47c1122372ff6a924c2165f1505a6fbee2bc7b136d78b75f2435d4eedd010e9e82f3273dc0fd46b9e78b1c9c6372bb532f1bc9fbc', 'id': '1273cfb8-3cea-46b3-b441-36223065ce39', 'created_at': datetime.datetime(2026, 11, 5, 14, 22, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 22, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1273cfb8-3cea-46b3-b441-36223065ce39/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfad9113320>}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed5660d-64db-4e21-8e5f-d6c67805a494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed5660d-64db-4e21-8e5f-d6c67805a494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9416fa-96b6-4fdb-bef2-fa793424b39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:43 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Volume 6d23ba4a-b288-4d38-a7b0-8de97ee962d7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6d23ba4a-b288-4d38-a7b0-8de97ee962d7', 'volume_size': 1, 'image_id': '1273cfb8-3cea-46b3-b441-36223065ce39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1273cfb8-3cea-46b3-b441-36223065ce39', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '17ce33b9b589782fe0e9c6c62a59aff3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '519be31ac0484d0a8907c0e22f583e84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '136dc18fdefc77fa214e6ad47c1122372ff6a924c2165f1505a6fbee2bc7b136d78b75f2435d4eedd010e9e82f3273dc0fd46b9e78b1c9c6372bb532f1bc9fbc', 'id': '1273cfb8-3cea-46b3-b441-36223065ce39', 'created_at': datetime.datetime(2026, 11, 5, 14, 22, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 22, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1273cfb8-3cea-46b3-b441-36223065ce39/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfad9113320>}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Trying to clone 6d23ba4a-b288-4d38-a7b0-8de97ee962d7 from image 1273cfb8-3cea-46b3-b441-36223065ce39 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1273cfb8-3cea-46b3-b441-36223065ce39', 'metadata': {}}]). {{(pid=87150) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 15:22:43 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b872603-5a7b-401b-8257-b00b08eef400]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:43 devstack sudo[106601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD
Nov 05 15:22:43 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:43 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1272a130-fc14-4e9d-bd8b-cc265700aa71 1073741824" returned: 0 in 0.491s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1272a130-fc14-4e9d-bd8b-cc265700aa71 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:43 devstack sudo[106603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1272a130-fc14-4e9d-bd8b-cc265700aa71
Nov 05 15:22:43 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:44 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:44 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1272a130-fc14-4e9d-bd8b-cc265700aa71" returned: 0 in 0.260s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:22:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:44 devstack sudo[106607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD
Nov 05 15:22:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-47320f31-8e29-4b2f-b459-a05ff5db3389 tempest-VolumeDependencyTests-651483409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.040s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:44 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be9ae2e6-67a9-46cb-bdf9-858ebfe5834c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1272a130-fc14-4e9d-bd8b-cc265700aa71', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (240da747-7c97-45f6-a14c-12f9222667c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-47320f31-8e29-4b2f-b459-a05ff5db3389 tempest-VolumeDependencyTests-651483409 None] Creating offline snapshot f3a17353-03d6-48f3-8991-8ad97fecb94c of volume 463bed9e-f856-4458-9771-1aae42a44d6f {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:22:44 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Volume volume-1272a130-fc14-4e9d-bd8b-cc265700aa71 (1272a130-fc14-4e9d-bd8b-cc265700aa71): created successfully
Nov 05 15:22:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (240da747-7c97-45f6-a14c-12f9222667c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Flow 'volume_create_manager' (adf0dbbd-6f2e-41fa-8e4a-6515cb7c0ea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:44 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[882a6b12-411d-447f-a794-f1e7c4d7a9f9]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47320f31-8e29-4b2f-b459-a05ff5db3389 tempest-VolumeDependencyTests-651483409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:44 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4200fb52-51bc-46c6-831c-c035c7e03c4e tempest-CreateVolumesFromImageTest-187754023 None] Created volume successfully.
Nov 05 15:22:44 devstack sudo[106610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f
Nov 05 15:22:44 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:44 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD" returned: 1 in 0.369s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 15:22:44 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Temporary image 1273cfb8-3cea-46b3-b441-36223065ce39 is fetched for user 562a045b58f04071a9f67e152c049122. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 15:22:44 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5d7b85-ebb6-4820-824f-f69658ce1136]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:44 devstack sudo[106615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD
Nov 05 15:22:44 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:44 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47320f31-8e29-4b2f-b459-a05ff5db3389 tempest-VolumeDependencyTests-651483409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f" returned: 0 in 0.386s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47320f31-8e29-4b2f-b459-a05ff5db3389 tempest-VolumeDependencyTests-651483409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.f3a17353-03d6-48f3-8991-8ad97fecb94c 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:44 devstack sudo[106620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.f3a17353-03d6-48f3-8991-8ad97fecb94c 1G
Nov 05 15:22:44 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:44 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:44 devstack sudo[106625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD
Nov 05 15:22:44 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:45 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47320f31-8e29-4b2f-b459-a05ff5db3389 tempest-VolumeDependencyTests-651483409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.f3a17353-03d6-48f3-8991-8ad97fecb94c 1G" returned: 0 in 0.409s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47320f31-8e29-4b2f-b459-a05ff5db3389 tempest-VolumeDependencyTests-651483409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-463bed9e-f856-4458-9771-1aae42a44d6f -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.f3a17353-03d6-48f3-8991-8ad97fecb94c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:45 devstack sudo[106630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-463bed9e-f856-4458-9771-1aae42a44d6f -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.f3a17353-03d6-48f3-8991-8ad97fecb94c
Nov 05 15:22:45 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:45 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD" returned: 1 in 0.341s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 15:22:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:45 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47320f31-8e29-4b2f-b459-a05ff5db3389 tempest-VolumeDependencyTests-651483409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-463bed9e-f856-4458-9771-1aae42a44d6f -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.f3a17353-03d6-48f3-8991-8ad97fecb94c" returned: 0 in 0.285s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:45 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-47320f31-8e29-4b2f-b459-a05ff5db3389 tempest-VolumeDependencyTests-651483409 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.f3a17353-03d6-48f3-8991-8ad97fecb94c is being set with open permissions: ugo+rw
Nov 05 15:22:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47320f31-8e29-4b2f-b459-a05ff5db3389 tempest-VolumeDependencyTests-651483409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.f3a17353-03d6-48f3-8991-8ad97fecb94c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:45 devstack sudo[106638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.f3a17353-03d6-48f3-8991-8ad97fecb94c
Nov 05 15:22:45 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:45 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47320f31-8e29-4b2f-b459-a05ff5db3389 tempest-VolumeDependencyTests-651483409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.f3a17353-03d6-48f3-8991-8ad97fecb94c" returned: 0 in 0.248s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47320f31-8e29-4b2f-b459-a05ff5db3389 tempest-VolumeDependencyTests-651483409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:45 devstack sudo[106641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.info
Nov 05 15:22:45 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:45 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47320f31-8e29-4b2f-b459-a05ff5db3389 tempest-VolumeDependencyTests-651483409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.info" returned: 0 in 0.248s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:45 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-47320f31-8e29-4b2f-b459-a05ff5db3389 tempest-VolumeDependencyTests-651483409 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.info is being set with open permissions: ugo+rw
Nov 05 15:22:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47320f31-8e29-4b2f-b459-a05ff5db3389 tempest-VolumeDependencyTests-651483409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:45 devstack sudo[106644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.info
Nov 05 15:22:45 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:46 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47320f31-8e29-4b2f-b459-a05ff5db3389 tempest-VolumeDependencyTests-651483409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.info" returned: 0 in 0.262s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-47320f31-8e29-4b2f-b459-a05ff5db3389 tempest-VolumeDependencyTests-651483409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.959s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.917s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1880338489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d60281-0b66-42b8-bfb0-25e92d00b26c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb87d54af6a467383b64171af82dca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:41Z,use_quota=True,user_id='be1f2a9942ba401d924f55f250f2aa8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Creating volume 90d60281-0b66-42b8-bfb0-25e92d00b26c {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:22:46 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-90d60281-0b66-42b8-bfb0-25e92d00b26c 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:46 devstack sudo[106647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-90d60281-0b66-42b8-bfb0-25e92d00b26c 1073741824
Nov 05 15:22:46 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:46 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-47320f31-8e29-4b2f-b459-a05ff5db3389 tempest-VolumeDependencyTests-651483409 None] Create snapshot completed successfully
Nov 05 15:22:46 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-90d60281-0b66-42b8-bfb0-25e92d00b26c 1073741824" returned: 0 in 0.416s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-90d60281-0b66-42b8-bfb0-25e92d00b26c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:46 devstack sudo[106653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-90d60281-0b66-42b8-bfb0-25e92d00b26c
Nov 05 15:22:46 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:46 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-90d60281-0b66-42b8-bfb0-25e92d00b26c" returned: 0 in 0.243s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e6ecfdb7-6a77-4cc2-be50-1956b843b98e tempest-ProjectMemberTests-340429542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.303s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0120baee-9b73-4110-8508-18760932ce20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90d60281-0b66-42b8-bfb0-25e92d00b26c', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27af3893-6019-48ee-a00e-db795a61833d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-e6ecfdb7-6a77-4cc2-be50-1956b843b98e tempest-ProjectMemberTests-340429542 None] Creating offline snapshot 095dff65-6194-4ed3-a01c-2092868e2faa of volume a8930ae8-2688-4111-8373-595472533243 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:22:46 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Volume volume-90d60281-0b66-42b8-bfb0-25e92d00b26c (90d60281-0b66-42b8-bfb0-25e92d00b26c): created successfully
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27af3893-6019-48ee-a00e-db795a61833d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Flow 'volume_create_manager' (d2e28fca-44ab-4cc5-a176-7fc7201d2f7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8481efce-600e-4454-8c97-d8e8836f76d7]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e6ecfdb7-6a77-4cc2-be50-1956b843b98e tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:46 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5c18ff29-3a02-4578-bd93-7f0829963038 tempest-CreateVolumesFromImageTest-187754023 None] Created volume successfully.
Nov 05 15:22:47 devstack sudo[106656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243
Nov 05 15:22:47 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:47 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e6ecfdb7-6a77-4cc2-be50-1956b843b98e tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243" returned: 0 in 0.362s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e6ecfdb7-6a77-4cc2-be50-1956b843b98e tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.095dff65-6194-4ed3-a01c-2092868e2faa 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:47 devstack sudo[106661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.095dff65-6194-4ed3-a01c-2092868e2faa 1G
Nov 05 15:22:47 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1f4145d5-6b37-42fa-affa-83a73d8cba65 tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "cinder-90d60281-0b66-42b8-bfb0-25e92d00b26c-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1f4145d5-6b37-42fa-affa-83a73d8cba65 tempest-CreateVolumesFromImageTest-187754023 None] Lock "cinder-90d60281-0b66-42b8-bfb0-25e92d00b26c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1f4145d5-6b37-42fa-affa-83a73d8cba65 tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "cinder-quobyte-90d60281-0b66-42b8-bfb0-25e92d00b26c" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1f4145d5-6b37-42fa-affa-83a73d8cba65 tempest-CreateVolumesFromImageTest-187754023 None] Lock "cinder-quobyte-90d60281-0b66-42b8-bfb0-25e92d00b26c" acquired by "delete_volume" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:47 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e6ecfdb7-6a77-4cc2-be50-1956b843b98e tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.095dff65-6194-4ed3-a01c-2092868e2faa 1G" returned: 0 in 0.568s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e6ecfdb7-6a77-4cc2-be50-1956b843b98e tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8930ae8-2688-4111-8373-595472533243 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.095dff65-6194-4ed3-a01c-2092868e2faa {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:47 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5188550-e08d-45dd-a395-753b51bbabd4]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:47 devstack sudo[106667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8930ae8-2688-4111-8373-595472533243 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.095dff65-6194-4ed3-a01c-2092868e2faa
Nov 05 15:22:47 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1f4145d5-6b37-42fa-affa-83a73d8cba65 tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-90d60281-0b66-42b8-bfb0-25e92d00b26c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:47 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:22:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Flow 'volume_create_manager' (962025a0-4977-4ee2-a095-56c62c5566bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (652a7b94-3e37-4f0e-a7af-784e715e02d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (652a7b94-3e37-4f0e-a7af-784e715e02d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-449327859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af49286c-1193-4872-a019-f2a3d27c6df3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6650fb51c93442aabb67a352e2c33c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f3a17353-03d6-48f3-8991-8ad97fecb94c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:48Z,use_quota=True,user_id='c685bc925346489abf626dd40b6339b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c16efd2c-7d7d-4f77-bc04-993b4cd8d141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c16efd2c-7d7d-4f77-bc04-993b4cd8d141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:47 devstack sudo[106669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-90d60281-0b66-42b8-bfb0-25e92d00b26c
Nov 05 15:22:47 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2def385e-a836-496b-8487-b7352867035f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2def385e-a836-496b-8487-b7352867035f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'af49286c-1193-4872-a019-f2a3d27c6df3', 'volume_name': 'volume-af49286c-1193-4872-a019-f2a3d27c6df3', 'volume_size': 1, 'snapshot_id': 'f3a17353-03d6-48f3-8991-8ad97fecb94c'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e8da14-3a64-4dd3-86a1-6506d346fc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e8da14-3a64-4dd3-86a1-6506d346fc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f4f5ac-82b6-45dd-922a-c025a2be1782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:48 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Volume af49286c-1193-4872-a019-f2a3d27c6df3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-af49286c-1193-4872-a019-f2a3d27c6df3', 'volume_size': 1, 'snapshot_id': 'f3a17353-03d6-48f3-8991-8ad97fecb94c'}
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:48 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e6ecfdb7-6a77-4cc2-be50-1956b843b98e tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8930ae8-2688-4111-8373-595472533243 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.095dff65-6194-4ed3-a01c-2092868e2faa" returned: 0 in 0.293s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:48 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-e6ecfdb7-6a77-4cc2-be50-1956b843b98e tempest-ProjectMemberTests-340429542 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.095dff65-6194-4ed3-a01c-2092868e2faa is being set with open permissions: ugo+rw
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e6ecfdb7-6a77-4cc2-be50-1956b843b98e tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.095dff65-6194-4ed3-a01c-2092868e2faa {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:48 devstack sudo[106674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.095dff65-6194-4ed3-a01c-2092868e2faa
Nov 05 15:22:48 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:48 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1f4145d5-6b37-42fa-affa-83a73d8cba65 tempest-CreateVolumesFromImageTest-187754023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-90d60281-0b66-42b8-bfb0-25e92d00b26c" returned: 0 in 0.380s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1f4145d5-6b37-42fa-affa-83a73d8cba65 tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-90d60281-0b66-42b8-bfb0-25e92d00b26c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:48 devstack sudo[106679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-90d60281-0b66-42b8-bfb0-25e92d00b26c
Nov 05 15:22:48 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:48 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e6ecfdb7-6a77-4cc2-be50-1956b843b98e tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.095dff65-6194-4ed3-a01c-2092868e2faa" returned: 0 in 0.272s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e6ecfdb7-6a77-4cc2-be50-1956b843b98e tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:48 devstack sudo[106682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.info
Nov 05 15:22:48 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:48 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1f4145d5-6b37-42fa-affa-83a73d8cba65 tempest-CreateVolumesFromImageTest-187754023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-90d60281-0b66-42b8-bfb0-25e92d00b26c" returned: 0 in 0.259s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1f4145d5-6b37-42fa-affa-83a73d8cba65 tempest-CreateVolumesFromImageTest-187754023 None] Lock "cinder-quobyte-90d60281-0b66-42b8-bfb0-25e92d00b26c" released by "delete_volume" :: held 0.705s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-1f4145d5-6b37-42fa-affa-83a73d8cba65 tempest-CreateVolumesFromImageTest-187754023 None] Created reservations ['49566972-4a70-47bf-863f-3ead1d81dac0', '8fde9340-b485-4660-8519-7948c6b84661', '2c11882c-d7cd-4416-9382-334e2a32c9b8', '03bef6db-2360-438b-a766-5ac57bda7cb2'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1f4145d5-6b37-42fa-affa-83a73d8cba65 tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1f4145d5-6b37-42fa-affa-83a73d8cba65 tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1f4145d5-6b37-42fa-affa-83a73d8cba65 tempest-CreateVolumesFromImageTest-187754023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1f4145d5-6b37-42fa-affa-83a73d8cba65 tempest-CreateVolumesFromImageTest-187754023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1f4145d5-6b37-42fa-affa-83a73d8cba65 tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1f4145d5-6b37-42fa-affa-83a73d8cba65 tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:48 devstack sudo[106685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:22:48 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:48 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e6ecfdb7-6a77-4cc2-be50-1956b843b98e tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.info" returned: 0 in 0.275s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:48 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-e6ecfdb7-6a77-4cc2-be50-1956b843b98e tempest-ProjectMemberTests-340429542 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.info is being set with open permissions: ugo+rw
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e6ecfdb7-6a77-4cc2-be50-1956b843b98e tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:48 devstack sudo[106688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.info
Nov 05 15:22:48 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f5d19bd2-dc09-461a-a39e-4d0c233751fb tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "cinder-1272a130-fc14-4e9d-bd8b-cc265700aa71-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:48 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f5d19bd2-dc09-461a-a39e-4d0c233751fb tempest-CreateVolumesFromImageTest-187754023 None] Lock "cinder-1272a130-fc14-4e9d-bd8b-cc265700aa71-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1f4145d5-6b37-42fa-affa-83a73d8cba65 tempest-CreateVolumesFromImageTest-187754023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.287s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-1f4145d5-6b37-42fa-affa-83a73d8cba65 tempest-CreateVolumesFromImageTest-187754023 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:22:48 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1f4145d5-6b37-42fa-affa-83a73d8cba65 tempest-CreateVolumesFromImageTest-187754023 None] Deleted volume successfully.
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1f4145d5-6b37-42fa-affa-83a73d8cba65 tempest-CreateVolumesFromImageTest-187754023 None] Lock "cinder-90d60281-0b66-42b8-bfb0-25e92d00b26c-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f5d19bd2-dc09-461a-a39e-4d0c233751fb tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "cinder-quobyte-1272a130-fc14-4e9d-bd8b-cc265700aa71" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f5d19bd2-dc09-461a-a39e-4d0c233751fb tempest-CreateVolumesFromImageTest-187754023 None] Lock "cinder-quobyte-1272a130-fc14-4e9d-bd8b-cc265700aa71" acquired by "delete_volume" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:49 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e6ecfdb7-6a77-4cc2-be50-1956b843b98e tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.info" returned: 0 in 0.290s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e6ecfdb7-6a77-4cc2-be50-1956b843b98e tempest-ProjectMemberTests-340429542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.169s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdebf26c-ed83-4d59-8646-690993d73db0]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.849s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d23ba4a-b288-4d38-a7b0-8de97ee962d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='519be31ac0484d0a8907c0e22f583e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:43Z,use_quota=True,user_id='562a045b58f04071a9f67e152c049122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ca428a-6a9d-4aa9-964b-7a92d3267941),volume_type_id=11ca428a-6a9d-4aa9-964b-7a92d3267941)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Creating volume 6d23ba4a-b288-4d38-a7b0-8de97ee962d7 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:22:49 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6d23ba4a-b288-4d38-a7b0-8de97ee962d7 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f5d19bd2-dc09-461a-a39e-4d0c233751fb tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1272a130-fc14-4e9d-bd8b-cc265700aa71 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:49 devstack sudo[106692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6d23ba4a-b288-4d38-a7b0-8de97ee962d7 1073741824
Nov 05 15:22:49 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:49 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e6ecfdb7-6a77-4cc2-be50-1956b843b98e tempest-ProjectMemberTests-340429542 None] Create snapshot completed successfully
Nov 05 15:22:49 devstack sudo[106693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1272a130-fc14-4e9d-bd8b-cc265700aa71
Nov 05 15:22:49 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:49 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f5d19bd2-dc09-461a-a39e-4d0c233751fb tempest-CreateVolumesFromImageTest-187754023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1272a130-fc14-4e9d-bd8b-cc265700aa71" returned: 0 in 0.445s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f5d19bd2-dc09-461a-a39e-4d0c233751fb tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1272a130-fc14-4e9d-bd8b-cc265700aa71 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:49 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6d23ba4a-b288-4d38-a7b0-8de97ee962d7 1073741824" returned: 0 in 0.477s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:49 devstack sudo[106704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1272a130-fc14-4e9d-bd8b-cc265700aa71
Nov 05 15:22:49 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6d23ba4a-b288-4d38-a7b0-8de97ee962d7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:49 devstack sudo[106706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6d23ba4a-b288-4d38-a7b0-8de97ee962d7
Nov 05 15:22:49 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:49 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f5d19bd2-dc09-461a-a39e-4d0c233751fb tempest-CreateVolumesFromImageTest-187754023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1272a130-fc14-4e9d-bd8b-cc265700aa71" returned: 0 in 0.269s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f5d19bd2-dc09-461a-a39e-4d0c233751fb tempest-CreateVolumesFromImageTest-187754023 None] Lock "cinder-quobyte-1272a130-fc14-4e9d-bd8b-cc265700aa71" released by "delete_volume" :: held 0.803s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:49 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-63947ec9-ba29-43dd-be96-96cac01f78f7 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-095dff65-6194-4ed3-a01c-2092868e2faa-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6d23ba4a-b288-4d38-a7b0-8de97ee962d7" returned: 0 in 0.270s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.818s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Acquiring lock "cinder-quobyte-f3a17353-03d6-48f3-8991-8ad97fecb94c-af49286c-1193-4872-a019-f2a3d27c6df3" by "_create_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-63947ec9-ba29-43dd-be96-96cac01f78f7 tempest-ProjectMemberTests-340429542 None] Lock "cinder-095dff65-6194-4ed3-a01c-2092868e2faa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-63947ec9-ba29-43dd-be96-96cac01f78f7 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-a8930ae8-2688-4111-8373-595472533243" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Lock "cinder-quobyte-f3a17353-03d6-48f3-8991-8ad97fecb94c-af49286c-1193-4872-a019-f2a3d27c6df3" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Creating volume af49286c-1193-4872-a019-f2a3d27c6df3 from snapshot f3a17353-03d6-48f3-8991-8ad97fecb94c {{(pid=87150) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Acquiring lock "cinder-quobyte-af49286c-1193-4872-a019-f2a3d27c6df3" by "_copy_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-63947ec9-ba29-43dd-be96-96cac01f78f7 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-a8930ae8-2688-4111-8373-595472533243" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-63947ec9-ba29-43dd-be96-96cac01f78f7 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-095dff65-6194-4ed3-a01c-2092868e2faa" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Attempting download of 1273cfb8-3cea-46b3-b441-36223065ce39 ((None, [{'url': 'file:///opt/stack/data/glance/images/1273cfb8-3cea-46b3-b441-36223065ce39', 'metadata': {}}])) to volume 6d23ba4a-b288-4d38-a7b0-8de97ee962d7. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Lock "cinder-quobyte-af49286c-1193-4872-a019-f2a3d27c6df3" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] snapshot: f3a17353-03d6-48f3-8991-8ad97fecb94c, volume: af49286c-1193-4872-a019-f2a3d27c6df3,  {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-63947ec9-ba29-43dd-be96-96cac01f78f7 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-095dff65-6194-4ed3-a01c-2092868e2faa" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-63947ec9-ba29-43dd-be96-96cac01f78f7 tempest-ProjectMemberTests-340429542 None] Deleting offline snapshot 095dff65-6194-4ed3-a01c-2092868e2faa of volume a8930ae8-2688-4111-8373-595472533243 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-63947ec9-ba29-43dd-be96-96cac01f78f7 tempest-ProjectMemberTests-340429542 None] snapshot_file for this snap is: volume-a8930ae8-2688-4111-8373-595472533243.095dff65-6194-4ed3-a01c-2092868e2faa {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba485931-f752-466b-893e-7d713fd4fd84]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63947ec9-ba29-43dd-be96-96cac01f78f7 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.095dff65-6194-4ed3-a01c-2092868e2faa {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fef400-881c-483a-b366-0daff58a4744]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1273cfb8-3cea-46b3-b441-36223065ce39_qi2niiqv {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-f5d19bd2-dc09-461a-a39e-4d0c233751fb tempest-CreateVolumesFromImageTest-187754023 None] Created reservations ['e90c77ba-b8bc-4534-a9b3-e976eec2c6a0', '4dcfc79b-bc26-4ca1-9b53-2f5b94f69d96', '0768ce12-d5d7-4b5c-a48c-cb6332eb5f77', '5f8dda08-a2db-40f9-9484-3a020c84257c'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[affd6e1b-9ed9-4968-9f20-10c7e54094d5]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.f3a17353-03d6-48f3-8991-8ad97fecb94c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:50 devstack sudo[106711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1273cfb8-3cea-46b3-b441-36223065ce39_qi2niiqv
Nov 05 15:22:50 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:50 devstack sudo[106710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.095dff65-6194-4ed3-a01c-2092868e2faa
Nov 05 15:22:50 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f5d19bd2-dc09-461a-a39e-4d0c233751fb tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f5d19bd2-dc09-461a-a39e-4d0c233751fb tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f5d19bd2-dc09-461a-a39e-4d0c233751fb tempest-CreateVolumesFromImageTest-187754023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f5d19bd2-dc09-461a-a39e-4d0c233751fb tempest-CreateVolumesFromImageTest-187754023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f5d19bd2-dc09-461a-a39e-4d0c233751fb tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f5d19bd2-dc09-461a-a39e-4d0c233751fb tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:50 devstack sudo[106715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:22:50 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:50 devstack sudo[106712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.f3a17353-03d6-48f3-8991-8ad97fecb94c
Nov 05 15:22:50 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:50 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1273cfb8-3cea-46b3-b441-36223065ce39_qi2niiqv" returned: 0 in 0.370s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1273cfb8-3cea-46b3-b441-36223065ce39_qi2niiqv {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:50 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63947ec9-ba29-43dd-be96-96cac01f78f7 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.095dff65-6194-4ed3-a01c-2092868e2faa" returned: 0 in 0.437s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-63947ec9-ba29-43dd-be96-96cac01f78f7 tempest-ProjectMemberTests-340429542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8930ae8-2688-4111-8373-595472533243(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:22:50 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f5d19bd2-dc09-461a-a39e-4d0c233751fb tempest-CreateVolumesFromImageTest-187754023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.294s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-f5d19bd2-dc09-461a-a39e-4d0c233751fb tempest-CreateVolumesFromImageTest-187754023 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbd1b05-85b1-4887-b1cd-f50046240ef7]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63947ec9-ba29-43dd-be96-96cac01f78f7 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:50 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f5d19bd2-dc09-461a-a39e-4d0c233751fb tempest-CreateVolumesFromImageTest-187754023 None] Deleted volume successfully.
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f5d19bd2-dc09-461a-a39e-4d0c233751fb tempest-CreateVolumesFromImageTest-187754023 None] Lock "cinder-1272a130-fc14-4e9d-bd8b-cc265700aa71-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:50 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:50 devstack sudo[106723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1273cfb8-3cea-46b3-b441-36223065ce39_qi2niiqv
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.f3a17353-03d6-48f3-8991-8ad97fecb94c" returned: 0 in 0.446s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-463bed9e-f856-4458-9771-1aae42a44d6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:22:50 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5ae666-076a-440d-a293-cecb2e02cd26]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:50 devstack sudo[106728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243
Nov 05 15:22:50 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:50 devstack sudo[106730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f
Nov 05 15:22:50 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:50 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1273cfb8-3cea-46b3-b441-36223065ce39_qi2niiqv" returned: 1 in 0.374s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1273cfb8-3cea-46b3-b441-36223065ce39_qi2niiqv' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96d27f5-c4ca-4e1a-8e92-0300a2b3df33]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:50 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63947ec9-ba29-43dd-be96-96cac01f78f7 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243" returned: 0 in 0.383s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63947ec9-ba29-43dd-be96-96cac01f78f7 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.095dff65-6194-4ed3-a01c-2092868e2faa {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:50 devstack sudo[106735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD
Nov 05 15:22:50 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:50 devstack sudo[106740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.095dff65-6194-4ed3-a01c-2092868e2faa
Nov 05 15:22:50 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:50 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f" returned: 0 in 0.402s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Creating direct copy from snapshot {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG cinder.utils [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Path /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af49286c-1193-4872-a019-f2a3d27c6df3 not found in is_blk_device check {{(pid=87150) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 15:22:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af49286c-1193-4872-a019-f2a3d27c6df3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:50 devstack sudo[106745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af49286c-1193-4872-a019-f2a3d27c6df3
Nov 05 15:22:50 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:51 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d5d1ee4e-9511-4a20-82b6-46d9772f1776 tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "cinder-81b42c7e-7532-4ebb-afa0-2f05f6fa7d00-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d5d1ee4e-9511-4a20-82b6-46d9772f1776 tempest-CreateVolumesFromImageTest-187754023 None] Lock "cinder-81b42c7e-7532-4ebb-afa0-2f05f6fa7d00-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:51 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d5d1ee4e-9511-4a20-82b6-46d9772f1776 tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "cinder-quobyte-81b42c7e-7532-4ebb-afa0-2f05f6fa7d00" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63947ec9-ba29-43dd-be96-96cac01f78f7 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.095dff65-6194-4ed3-a01c-2092868e2faa" returned: 0 in 0.451s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63947ec9-ba29-43dd-be96-96cac01f78f7 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.095dff65-6194-4ed3-a01c-2092868e2faa {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:51 devstack sudo[106751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD
Nov 05 15:22:51 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d5d1ee4e-9511-4a20-82b6-46d9772f1776 tempest-CreateVolumesFromImageTest-187754023 None] Lock "cinder-quobyte-81b42c7e-7532-4ebb-afa0-2f05f6fa7d00" acquired by "delete_volume" :: waited 0.035s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:51 devstack sudo[106758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.095dff65-6194-4ed3-a01c-2092868e2faa
Nov 05 15:22:51 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:51 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c645cc7d-95d5-4c2e-8a10-755c9d39c233]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d5d1ee4e-9511-4a20-82b6-46d9772f1776 tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-81b42c7e-7532-4ebb-afa0-2f05f6fa7d00 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:51 devstack sudo[106760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-81b42c7e-7532-4ebb-afa0-2f05f6fa7d00
Nov 05 15:22:51 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:51 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD" returned: 1 in 0.500s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 15:22:51 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] 1273cfb8-3cea-46b3-b441-36223065ce39 was raw, converting to qcow2 {{(pid=87150) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 15:22:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6d23ba4a-b288-4d38-a7b0-8de97ee962d7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:51 devstack sudo[106770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6d23ba4a-b288-4d38-a7b0-8de97ee962d7
Nov 05 15:22:51 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:51 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63947ec9-ba29-43dd-be96-96cac01f78f7 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243.095dff65-6194-4ed3-a01c-2092868e2faa" returned: 0 in 0.439s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-63947ec9-ba29-43dd-be96-96cac01f78f7 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-095dff65-6194-4ed3-a01c-2092868e2faa" released by "_delete_snapshot" :: held 1.936s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-63947ec9-ba29-43dd-be96-96cac01f78f7 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-a8930ae8-2688-4111-8373-595472533243" released by "delete_snapshot" :: held 1.979s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:52 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-63947ec9-ba29-43dd-be96-96cac01f78f7 tempest-ProjectMemberTests-340429542 None] Created reservations ['db671bae-7263-422d-b75d-59414d60bc65', '867d0ce8-b1cd-42cc-b812-7c38cb4346cf', '8d52a56b-1f8a-4f17-b5dc-92eb3939ea00', 'b5dcc2af-6d22-49a2-a64c-5befd710b90e'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:22:52 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d5d1ee4e-9511-4a20-82b6-46d9772f1776 tempest-CreateVolumesFromImageTest-187754023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-81b42c7e-7532-4ebb-afa0-2f05f6fa7d00" returned: 0 in 0.808s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d5d1ee4e-9511-4a20-82b6-46d9772f1776 tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-81b42c7e-7532-4ebb-afa0-2f05f6fa7d00 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:52 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-63947ec9-ba29-43dd-be96-96cac01f78f7 tempest-ProjectMemberTests-340429542 None] Delete snapshot completed successfully.
Nov 05 15:22:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-63947ec9-ba29-43dd-be96-96cac01f78f7 tempest-ProjectMemberTests-340429542 None] Lock "cinder-095dff65-6194-4ed3-a01c-2092868e2faa-delete_snapshot" released by "delete_snapshot" :: held 2.347s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:52 devstack sudo[106780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-81b42c7e-7532-4ebb-afa0-2f05f6fa7d00
Nov 05 15:22:52 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:52 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d5d1ee4e-9511-4a20-82b6-46d9772f1776 tempest-CreateVolumesFromImageTest-187754023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-81b42c7e-7532-4ebb-afa0-2f05f6fa7d00" returned: 0 in 0.445s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d5d1ee4e-9511-4a20-82b6-46d9772f1776 tempest-CreateVolumesFromImageTest-187754023 None] Lock "cinder-quobyte-81b42c7e-7532-4ebb-afa0-2f05f6fa7d00" released by "delete_volume" :: held 1.305s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:52 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-d5d1ee4e-9511-4a20-82b6-46d9772f1776 tempest-CreateVolumesFromImageTest-187754023 None] Created reservations ['58c255f1-9497-44c5-bd21-c2e4b952b8da', 'cb6e6fa2-4fbc-4d11-8c6a-bc9a6134ae0b', 'f24c78e0-c21e-4acf-985a-47fa9a75c9c0', 'a7595c98-0ea9-4c1c-af32-bd21bcc22f43'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:22:52 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6d23ba4a-b288-4d38-a7b0-8de97ee962d7" returned: 0 in 1.080s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:52 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1273cfb8-3cea-46b3-b441-36223065ce39_270sloe0devstack@QuobyteHD, size 0.00 MB, duration 1.08 sec, destination /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6d23ba4a-b288-4d38-a7b0-8de97ee962d7 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:22:52 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 15:22:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6d23ba4a-b288-4d38-a7b0-8de97ee962d7 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:52 devstack sudo[106785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6d23ba4a-b288-4d38-a7b0-8de97ee962d7 1G
Nov 05 15:22:52 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d5d1ee4e-9511-4a20-82b6-46d9772f1776 tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d5d1ee4e-9511-4a20-82b6-46d9772f1776 tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d5d1ee4e-9511-4a20-82b6-46d9772f1776 tempest-CreateVolumesFromImageTest-187754023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d5d1ee4e-9511-4a20-82b6-46d9772f1776 tempest-CreateVolumesFromImageTest-187754023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d5d1ee4e-9511-4a20-82b6-46d9772f1776 tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d5d1ee4e-9511-4a20-82b6-46d9772f1776 tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:53 devstack sudo[106787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:22:53 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9d62c76c-beb4-4332-bafa-9ca93ec0846d tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-a8930ae8-2688-4111-8373-595472533243-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9d62c76c-beb4-4332-bafa-9ca93ec0846d tempest-ProjectMemberTests-340429542 None] Lock "cinder-a8930ae8-2688-4111-8373-595472533243-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9d62c76c-beb4-4332-bafa-9ca93ec0846d tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-a8930ae8-2688-4111-8373-595472533243" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9d62c76c-beb4-4332-bafa-9ca93ec0846d tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-a8930ae8-2688-4111-8373-595472533243" acquired by "delete_volume" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:53 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d5d1ee4e-9511-4a20-82b6-46d9772f1776 tempest-CreateVolumesFromImageTest-187754023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.542s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:53 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-d5d1ee4e-9511-4a20-82b6-46d9772f1776 tempest-CreateVolumesFromImageTest-187754023 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:22:53 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d5d1ee4e-9511-4a20-82b6-46d9772f1776 tempest-CreateVolumesFromImageTest-187754023 None] Deleted volume successfully.
Nov 05 15:22:53 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1bf0ff-04cb-4c4f-8716-2eabc6551284]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9d62c76c-beb4-4332-bafa-9ca93ec0846d tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d5d1ee4e-9511-4a20-82b6-46d9772f1776 tempest-CreateVolumesFromImageTest-187754023 None] Lock "cinder-81b42c7e-7532-4ebb-afa0-2f05f6fa7d00-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:53 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6d23ba4a-b288-4d38-a7b0-8de97ee962d7 1G" returned: 0 in 0.880s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:53 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Downloaded image 1273cfb8-3cea-46b3-b441-36223065ce39 ((None, [{'url': 'file:///opt/stack/data/glance/images/1273cfb8-3cea-46b3-b441-36223065ce39', 'metadata': {}}])) to volume 6d23ba4a-b288-4d38-a7b0-8de97ee962d7 successfully. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 15:22:53 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Temporary image 1273cfb8-3cea-46b3-b441-36223065ce39 for user 562a045b58f04071a9f67e152c049122 is deleted. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 15:22:53 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Marking volume 6d23ba4a-b288-4d38-a7b0-8de97ee962d7 as bootable. {{(pid=87150) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 15:22:53 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Copying metadata from image 1273cfb8-3cea-46b3-b441-36223065ce39 to 6d23ba4a-b288-4d38-a7b0-8de97ee962d7. {{(pid=87150) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 15:22:53 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Creating volume glance metadata for volume 6d23ba4a-b288-4d38-a7b0-8de97ee962d7 backed by image 1273cfb8-3cea-46b3-b441-36223065ce39 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1273cfb8-3cea-46b3-b441-36223065ce39', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '17ce33b9b589782fe0e9c6c62a59aff3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87150) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 15:22:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6a36b76d-3751-4446-890e-edfc0186d4ae tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "cinder-329159af-f802-41dc-b385-9400ab3c1644-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6a36b76d-3751-4446-890e-edfc0186d4ae tempest-CreateVolumesFromImageTest-187754023 None] Lock "cinder-329159af-f802-41dc-b385-9400ab3c1644-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6a36b76d-3751-4446-890e-edfc0186d4ae tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "cinder-quobyte-329159af-f802-41dc-b385-9400ab3c1644" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:53 devstack sudo[106794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243
Nov 05 15:22:53 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6a36b76d-3751-4446-890e-edfc0186d4ae tempest-CreateVolumesFromImageTest-187754023 None] Lock "cinder-quobyte-329159af-f802-41dc-b385-9400ab3c1644" acquired by "delete_volume" :: waited 0.058s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9416fa-96b6-4fdb-bef2-fa793424b39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d23ba4a-b288-4d38-a7b0-8de97ee962d7', 'volume_size': 1, 'image_id': '1273cfb8-3cea-46b3-b441-36223065ce39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1273cfb8-3cea-46b3-b441-36223065ce39', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '17ce33b9b589782fe0e9c6c62a59aff3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '519be31ac0484d0a8907c0e22f583e84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '136dc18fdefc77fa214e6ad47c1122372ff6a924c2165f1505a6fbee2bc7b136d78b75f2435d4eedd010e9e82f3273dc0fd46b9e78b1c9c6372bb532f1bc9fbc', 'id': '1273cfb8-3cea-46b3-b441-36223065ce39', 'created_at': datetime.datetime(2026, 11, 5, 14, 22, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 22, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1273cfb8-3cea-46b3-b441-36223065ce39/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfad9113320>}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78531242-f545-490a-9729-7406f98db76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:53 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2553cfee-e97c-4f32-8955-a9adce4dc70d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a36b76d-3751-4446-890e-edfc0186d4ae tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-329159af-f802-41dc-b385-9400ab3c1644 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:54 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Volume volume-6d23ba4a-b288-4d38-a7b0-8de97ee962d7 (6d23ba4a-b288-4d38-a7b0-8de97ee962d7): created successfully
Nov 05 15:22:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78531242-f545-490a-9729-7406f98db76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Flow 'volume_create_manager' (09ff05e2-4259-4b42-b382-69bf9f0b9975) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:54 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-85ae40c8-860d-42c1-a4aa-1110e5697e8b tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Created volume successfully.
Nov 05 15:22:54 devstack sudo[106796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-329159af-f802-41dc-b385-9400ab3c1644
Nov 05 15:22:54 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:54 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9d62c76c-beb4-4332-bafa-9ca93ec0846d tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243" returned: 0 in 0.886s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9d62c76c-beb4-4332-bafa-9ca93ec0846d tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:54 devstack sudo[106804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243
Nov 05 15:22:54 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:54 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a36b76d-3751-4446-890e-edfc0186d4ae tempest-CreateVolumesFromImageTest-187754023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-329159af-f802-41dc-b385-9400ab3c1644" returned: 0 in 0.567s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a36b76d-3751-4446-890e-edfc0186d4ae tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-329159af-f802-41dc-b385-9400ab3c1644 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:54 devstack sudo[106806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-329159af-f802-41dc-b385-9400ab3c1644
Nov 05 15:22:54 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:54 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a36b76d-3751-4446-890e-edfc0186d4ae tempest-CreateVolumesFromImageTest-187754023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-329159af-f802-41dc-b385-9400ab3c1644" returned: 0 in 0.428s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:55 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9d62c76c-beb4-4332-bafa-9ca93ec0846d tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-a8930ae8-2688-4111-8373-595472533243" returned: 0 in 0.587s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6a36b76d-3751-4446-890e-edfc0186d4ae tempest-CreateVolumesFromImageTest-187754023 None] Lock "cinder-quobyte-329159af-f802-41dc-b385-9400ab3c1644" released by "delete_volume" :: held 1.173s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9d62c76c-beb4-4332-bafa-9ca93ec0846d tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-a8930ae8-2688-4111-8373-595472533243" released by "delete_volume" :: held 1.689s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:55 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-6a36b76d-3751-4446-890e-edfc0186d4ae tempest-CreateVolumesFromImageTest-187754023 None] Created reservations ['9576f84d-b9ed-4231-a2be-ab2ef1266378', 'e03d2a8a-f6c9-43ea-b0ae-0c21bc52af78', '76c808e2-44d9-463f-8ee0-39f7959105db', 'ce89b748-dd5b-476c-a04c-bae08af30647'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:22:55 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-9d62c76c-beb4-4332-bafa-9ca93ec0846d tempest-ProjectMemberTests-340429542 None] Created reservations ['b5b78cc5-8624-4eeb-b7bd-a61bca8f2f6f', '0d1a4ce7-fb07-4b92-b2a0-f044c2e4f854', '7e01c1b7-6cff-468f-b6f7-fba96828dd05', '100b7eb6-d8aa-42aa-a309-e2dc553ca5f1'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:22:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1be8d4fc-d068-4854-a7d8-f8d7ffdf03da tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Acquiring lock "cinder-6d23ba4a-b288-4d38-a7b0-8de97ee962d7-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1be8d4fc-d068-4854-a7d8-f8d7ffdf03da tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Lock "cinder-6d23ba4a-b288-4d38-a7b0-8de97ee962d7-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6a36b76d-3751-4446-890e-edfc0186d4ae tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6a36b76d-3751-4446-890e-edfc0186d4ae tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6a36b76d-3751-4446-890e-edfc0186d4ae tempest-CreateVolumesFromImageTest-187754023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6a36b76d-3751-4446-890e-edfc0186d4ae tempest-CreateVolumesFromImageTest-187754023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6a36b76d-3751-4446-890e-edfc0186d4ae tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a36b76d-3751-4446-890e-edfc0186d4ae tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1be8d4fc-d068-4854-a7d8-f8d7ffdf03da tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Acquiring lock "cinder-quobyte-6d23ba4a-b288-4d38-a7b0-8de97ee962d7" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:55 devstack sudo[106810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:22:55 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1be8d4fc-d068-4854-a7d8-f8d7ffdf03da tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Lock "cinder-quobyte-6d23ba4a-b288-4d38-a7b0-8de97ee962d7" acquired by "delete_volume" :: waited 0.048s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9d62c76c-beb4-4332-bafa-9ca93ec0846d tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9d62c76c-beb4-4332-bafa-9ca93ec0846d tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9d62c76c-beb4-4332-bafa-9ca93ec0846d tempest-ProjectMemberTests-340429542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9d62c76c-beb4-4332-bafa-9ca93ec0846d tempest-ProjectMemberTests-340429542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9d62c76c-beb4-4332-bafa-9ca93ec0846d tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9d62c76c-beb4-4332-bafa-9ca93ec0846d tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:55 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[89babdd4-3ebc-4e17-a436-25a72e0f80ca]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1be8d4fc-d068-4854-a7d8-f8d7ffdf03da tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6d23ba4a-b288-4d38-a7b0-8de97ee962d7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:55 devstack sudo[106812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:22:55 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:55 devstack sudo[106813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6d23ba4a-b288-4d38-a7b0-8de97ee962d7
Nov 05 15:22:55 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:56 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a36b76d-3751-4446-890e-edfc0186d4ae tempest-CreateVolumesFromImageTest-187754023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.539s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:56 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-6a36b76d-3751-4446-890e-edfc0186d4ae tempest-CreateVolumesFromImageTest-187754023 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:22:56 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6a36b76d-3751-4446-890e-edfc0186d4ae tempest-CreateVolumesFromImageTest-187754023 None] Deleted volume successfully.
Nov 05 15:22:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6a36b76d-3751-4446-890e-edfc0186d4ae tempest-CreateVolumesFromImageTest-187754023 None] Lock "cinder-329159af-f802-41dc-b385-9400ab3c1644-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5a723da6-ec16-43b2-a930-862d3ba5e109 tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "cinder-c77f59b9-a134-4b59-8e29-ee9beec2b669-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5a723da6-ec16-43b2-a930-862d3ba5e109 tempest-CreateVolumesFromImageTest-187754023 None] Lock "cinder-c77f59b9-a134-4b59-8e29-ee9beec2b669-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5a723da6-ec16-43b2-a930-862d3ba5e109 tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "cinder-quobyte-c77f59b9-a134-4b59-8e29-ee9beec2b669" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:22:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5a723da6-ec16-43b2-a930-862d3ba5e109 tempest-CreateVolumesFromImageTest-187754023 None] Lock "cinder-quobyte-c77f59b9-a134-4b59-8e29-ee9beec2b669" acquired by "delete_volume" :: waited 0.039s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:22:56 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b101f5c-328e-45a9-bc43-895cea69c12b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:22:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5a723da6-ec16-43b2-a930-862d3ba5e109 tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c77f59b9-a134-4b59-8e29-ee9beec2b669 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:56 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9d62c76c-beb4-4332-bafa-9ca93ec0846d tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 1.072s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:56 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-9d62c76c-beb4-4332-bafa-9ca93ec0846d tempest-ProjectMemberTests-340429542 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:22:56 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:56 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9d62c76c-beb4-4332-bafa-9ca93ec0846d tempest-ProjectMemberTests-340429542 None] Deleted volume successfully.
Nov 05 15:22:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1be8d4fc-d068-4854-a7d8-f8d7ffdf03da tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6d23ba4a-b288-4d38-a7b0-8de97ee962d7" returned: 0 in 1.087s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1be8d4fc-d068-4854-a7d8-f8d7ffdf03da tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6d23ba4a-b288-4d38-a7b0-8de97ee962d7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:56 devstack sudo[106822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6d23ba4a-b288-4d38-a7b0-8de97ee962d7
Nov 05 15:22:56 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9d62c76c-beb4-4332-bafa-9ca93ec0846d tempest-ProjectMemberTests-340429542 None] Lock "cinder-a8930ae8-2688-4111-8373-595472533243-delete_volume" released by "delete_volume" :: held 3.549s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:56 devstack sudo[106821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c77f59b9-a134-4b59-8e29-ee9beec2b669
Nov 05 15:22:56 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:57 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:22:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Flow 'volume_create_manager' (3409633d-8ab2-4673-b37d-5c2e17067807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:22:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4496a00-a41b-4136-a5d1-e0b47a424314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4496a00-a41b-4136-a5d1-e0b47a424314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2097389823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e408950c-45a7-444b-8e0d-641f507a5d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9e03f4a164bf48042da27edfd742d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:57Z,use_quota=True,user_id='d3585054b64542a1a174061b1731d371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8fa726-fedd-4803-a436-344cb35b8840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8fa726-fedd-4803-a436-344cb35b8840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ef982d-3bb5-48ed-82d2-f9e8d37c10cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ef982d-3bb5-48ed-82d2-f9e8d37c10cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e408950c-45a7-444b-8e0d-641f507a5d0a', 'volume_name': 'volume-e408950c-45a7-444b-8e0d-641f507a5d0a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (071692bf-fe40-4eeb-a8b3-2fb4a09f178f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (071692bf-fe40-4eeb-a8b3-2fb4a09f178f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:22:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e38b86-5ea4-424d-a8d7-c865a1bdc4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:22:57 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Volume e408950c-45a7-444b-8e0d-641f507a5d0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e408950c-45a7-444b-8e0d-641f507a5d0a', 'volume_size': 1}
Nov 05 15:22:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:57 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1be8d4fc-d068-4854-a7d8-f8d7ffdf03da tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6d23ba4a-b288-4d38-a7b0-8de97ee962d7" returned: 0 in 0.522s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1be8d4fc-d068-4854-a7d8-f8d7ffdf03da tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Lock "cinder-quobyte-6d23ba4a-b288-4d38-a7b0-8de97ee962d7" released by "delete_volume" :: held 1.732s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:57 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-1be8d4fc-d068-4854-a7d8-f8d7ffdf03da tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Created reservations ['c3ada79a-5e4b-4efa-9593-d751bf06955d', '595dedc0-d19d-40d5-aed2-825f96ae2fc5', 'cbc29ae7-1ca8-4c4d-9cfa-13bc0c9f08f8', '29aaf2bd-9c6a-4248-bd06-f6a7fbd34592'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:22:57 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1be8d4fc-d068-4854-a7d8-f8d7ffdf03da tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1be8d4fc-d068-4854-a7d8-f8d7ffdf03da tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1be8d4fc-d068-4854-a7d8-f8d7ffdf03da tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1be8d4fc-d068-4854-a7d8-f8d7ffdf03da tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1be8d4fc-d068-4854-a7d8-f8d7ffdf03da tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1be8d4fc-d068-4854-a7d8-f8d7ffdf03da tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5a723da6-ec16-43b2-a930-862d3ba5e109 tempest-CreateVolumesFromImageTest-187754023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c77f59b9-a134-4b59-8e29-ee9beec2b669" returned: 0 in 0.955s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5a723da6-ec16-43b2-a930-862d3ba5e109 tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c77f59b9-a134-4b59-8e29-ee9beec2b669 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:57 devstack sudo[106829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:22:57 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:57 devstack sudo[106830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c77f59b9-a134-4b59-8e29-ee9beec2b669
Nov 05 15:22:57 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:58 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1be8d4fc-d068-4854-a7d8-f8d7ffdf03da tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.624s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:58 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-1be8d4fc-d068-4854-a7d8-f8d7ffdf03da tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:22:58 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1be8d4fc-d068-4854-a7d8-f8d7ffdf03da tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Deleted volume successfully.
Nov 05 15:22:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1be8d4fc-d068-4854-a7d8-f8d7ffdf03da tempest-VolumeAndVolumeTypeFromImageTest-371161411 None] Lock "cinder-6d23ba4a-b288-4d38-a7b0-8de97ee962d7-delete_volume" released by "delete_volume" :: held 2.993s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:58 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5a723da6-ec16-43b2-a930-862d3ba5e109 tempest-CreateVolumesFromImageTest-187754023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c77f59b9-a134-4b59-8e29-ee9beec2b669" returned: 0 in 0.715s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5a723da6-ec16-43b2-a930-862d3ba5e109 tempest-CreateVolumesFromImageTest-187754023 None] Lock "cinder-quobyte-c77f59b9-a134-4b59-8e29-ee9beec2b669" released by "delete_volume" :: held 1.826s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:58 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-5a723da6-ec16-43b2-a930-862d3ba5e109 tempest-CreateVolumesFromImageTest-187754023 None] Created reservations ['93c80b1e-7b71-432a-a035-3506d70e24cb', '3e134e0a-ef6a-42a7-9bf0-6d85749ec3c6', 'f92f00be-132f-457f-8c30-2a1fe013658b', '14563546-5272-4b5b-847f-2721b3a65ad5'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:22:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5a723da6-ec16-43b2-a930-862d3ba5e109 tempest-CreateVolumesFromImageTest-187754023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:22:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5a723da6-ec16-43b2-a930-862d3ba5e109 tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:22:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5a723da6-ec16-43b2-a930-862d3ba5e109 tempest-CreateVolumesFromImageTest-187754023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:22:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5a723da6-ec16-43b2-a930-862d3ba5e109 tempest-CreateVolumesFromImageTest-187754023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:22:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5a723da6-ec16-43b2-a930-862d3ba5e109 tempest-CreateVolumesFromImageTest-187754023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:22:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5a723da6-ec16-43b2-a930-862d3ba5e109 tempest-CreateVolumesFromImageTest-187754023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:22:58 devstack sudo[106835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:22:58 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:22:58 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5a723da6-ec16-43b2-a930-862d3ba5e109 tempest-CreateVolumesFromImageTest-187754023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.376s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:58 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-5a723da6-ec16-43b2-a930-862d3ba5e109 tempest-CreateVolumesFromImageTest-187754023 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:22:58 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5a723da6-ec16-43b2-a930-862d3ba5e109 tempest-CreateVolumesFromImageTest-187754023 None] Deleted volume successfully.
Nov 05 15:22:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5a723da6-ec16-43b2-a930-862d3ba5e109 tempest-CreateVolumesFromImageTest-187754023 None] Lock "cinder-c77f59b9-a134-4b59-8e29-ee9beec2b669-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:22:59 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root
Nov 05 15:22:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af49286c-1193-4872-a019-f2a3d27c6df3" returned: 0 in 9.027s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:22:59 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Image conversion details: src /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f, size 1024.00 MB, duration 9.03 sec, destination /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af49286c-1193-4872-a019-f2a3d27c6df3 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:22:59 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Converted 1024.00 MB image at 113.42 MB/s
Nov 05 15:22:59 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af49286c-1193-4872-a019-f2a3d27c6df3 is being set with open permissions: ugo+rw
Nov 05 15:23:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af49286c-1193-4872-a019-f2a3d27c6df3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:00 devstack sudo[106839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af49286c-1193-4872-a019-f2a3d27c6df3
Nov 05 15:23:00 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:00 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af49286c-1193-4872-a019-f2a3d27c6df3" returned: 0 in 0.324s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Lock "cinder-quobyte-af49286c-1193-4872-a019-f2a3d27c6df3" released by "_copy_volume_from_snapshot" :: held 10.393s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Lock "cinder-quobyte-f3a17353-03d6-48f3-8991-8ad97fecb94c-af49286c-1193-4872-a019-f2a3d27c6df3" released by "_create_volume_from_snapshot" :: held 10.481s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.525s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.149s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2097389823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e408950c-45a7-444b-8e0d-641f507a5d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9e03f4a164bf48042da27edfd742d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:57Z,use_quota=True,user_id='d3585054b64542a1a174061b1731d371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:23:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Creating volume e408950c-45a7-444b-8e0d-641f507a5d0a {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:23:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:23:00 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:23:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:00 devstack sudo[106843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a 1073741824
Nov 05 15:23:00 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f4f5ac-82b6-45dd-922a-c025a2be1782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af49286c-1193-4872-a019-f2a3d27c6df3', 'volume_size': 1, 'snapshot_id': 'f3a17353-03d6-48f3-8991-8ad97fecb94c'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad4debf2-9b9f-41ea-9088-05d3e6944357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:00 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Volume volume-af49286c-1193-4872-a019-f2a3d27c6df3 (af49286c-1193-4872-a019-f2a3d27c6df3): created successfully
Nov 05 15:23:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad4debf2-9b9f-41ea-9088-05d3e6944357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Flow 'volume_create_manager' (962025a0-4977-4ee2-a095-56c62c5566bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:00 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-90fb212f-59c2-46cf-9991-7f79affb95ef tempest-VolumeDependencyTests-651483409 None] Created volume successfully.
Nov 05 15:23:00 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a 1073741824" returned: 0 in 0.599s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:01 devstack sudo[106849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a
Nov 05 15:23:01 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:01 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a" returned: 0 in 0.305s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:23:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e38b86-5ea4-424d-a8d7-c865a1bdc4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e408950c-45a7-444b-8e0d-641f507a5d0a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164cfa6a-91ba-4a8b-8c30-b668e7d1449d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:01 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Volume volume-e408950c-45a7-444b-8e0d-641f507a5d0a (e408950c-45a7-444b-8e0d-641f507a5d0a): created successfully
Nov 05 15:23:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164cfa6a-91ba-4a8b-8c30-b668e7d1449d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Flow 'volume_create_manager' (3409633d-8ab2-4673-b37d-5c2e17067807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1930ac72-729d-4b89-b614-b95c9899f790 tempest-VolumeDependencyTests-651483409 None] Acquiring lock "cinder-f3a17353-03d6-48f3-8991-8ad97fecb94c-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-47e89e14-fcf2-4d07-83f4-2355fb2949c6 tempest-ProjectMemberTests-340429542 None] Created volume successfully.
Nov 05 15:23:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1930ac72-729d-4b89-b614-b95c9899f790 tempest-VolumeDependencyTests-651483409 None] Lock "cinder-f3a17353-03d6-48f3-8991-8ad97fecb94c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1930ac72-729d-4b89-b614-b95c9899f790 tempest-VolumeDependencyTests-651483409 None] Acquiring lock "cinder-quobyte-463bed9e-f856-4458-9771-1aae42a44d6f" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1930ac72-729d-4b89-b614-b95c9899f790 tempest-VolumeDependencyTests-651483409 None] Lock "cinder-quobyte-463bed9e-f856-4458-9771-1aae42a44d6f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1930ac72-729d-4b89-b614-b95c9899f790 tempest-VolumeDependencyTests-651483409 None] Acquiring lock "cinder-quobyte-f3a17353-03d6-48f3-8991-8ad97fecb94c" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1930ac72-729d-4b89-b614-b95c9899f790 tempest-VolumeDependencyTests-651483409 None] Lock "cinder-quobyte-f3a17353-03d6-48f3-8991-8ad97fecb94c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1930ac72-729d-4b89-b614-b95c9899f790 tempest-VolumeDependencyTests-651483409 None] Deleting offline snapshot f3a17353-03d6-48f3-8991-8ad97fecb94c of volume 463bed9e-f856-4458-9771-1aae42a44d6f {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:23:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1930ac72-729d-4b89-b614-b95c9899f790 tempest-VolumeDependencyTests-651483409 None] snapshot_file for this snap is: volume-463bed9e-f856-4458-9771-1aae42a44d6f.f3a17353-03d6-48f3-8991-8ad97fecb94c {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:23:01 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d915dbe-6fc9-4a33-99e1-23b994297ad6]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1930ac72-729d-4b89-b614-b95c9899f790 tempest-VolumeDependencyTests-651483409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.f3a17353-03d6-48f3-8991-8ad97fecb94c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:01 devstack sudo[106852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.f3a17353-03d6-48f3-8991-8ad97fecb94c
Nov 05 15:23:01 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:01 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1930ac72-729d-4b89-b614-b95c9899f790 tempest-VolumeDependencyTests-651483409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.f3a17353-03d6-48f3-8991-8ad97fecb94c" returned: 0 in 0.456s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1930ac72-729d-4b89-b614-b95c9899f790 tempest-VolumeDependencyTests-651483409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-463bed9e-f856-4458-9771-1aae42a44d6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:23:02 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[da872081-8742-4c86-9455-79f608d4efcf]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1930ac72-729d-4b89-b614-b95c9899f790 tempest-VolumeDependencyTests-651483409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:02 devstack sudo[106857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f
Nov 05 15:23:02 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:02 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1930ac72-729d-4b89-b614-b95c9899f790 tempest-VolumeDependencyTests-651483409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f" returned: 0 in 0.671s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1930ac72-729d-4b89-b614-b95c9899f790 tempest-VolumeDependencyTests-651483409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.f3a17353-03d6-48f3-8991-8ad97fecb94c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:02 devstack sudo[106862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.f3a17353-03d6-48f3-8991-8ad97fecb94c
Nov 05 15:23:02 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b7cb72d1-d02c-4194-85dd-9651c27b73c3 tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b7cb72d1-d02c-4194-85dd-9651c27b73c3 tempest-ProjectMemberTests-340429542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Flow 'volume_create_manager' (b2b63e83-f4ea-4c5e-99e8-8d7e4f829542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6cc725-56ef-4d58-bbaa-2d0d478d4176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b7cb72d1-d02c-4194-85dd-9651c27b73c3 tempest-ProjectMemberTests-340429542 None] Creating offline snapshot 6c96f264-5446-4c0c-a122-fdb1ab4b6701 of volume e408950c-45a7-444b-8e0d-641f507a5d0a {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6cc725-56ef-4d58-bbaa-2d0d478d4176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1276019682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95df3bfd-367b-42e8-b66d-9ced5028ea8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df1caec296c4850896ffa28c7b7d2b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:03Z,use_quota=True,user_id='545c323e4c124ff1b081df240c8a6522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db7ecf3-4ea4-438b-9c03-145932cae3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db7ecf3-4ea4-438b-9c03-145932cae3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7dcb9ca-8136-44c1-a8a3-22e68cc908c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7dcb9ca-8136-44c1-a8a3-22e68cc908c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95df3bfd-367b-42e8-b66d-9ced5028ea8b', 'volume_name': 'volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bf9b380-4187-4fc1-8004-835a6af84c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bf9b380-4187-4fc1-8004-835a6af84c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111a4349-e42d-4081-a23c-16afe073a955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:03 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Volume 95df3bfd-367b-42e8-b66d-9ced5028ea8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b', 'volume_size': 1}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[58020726-cd93-492b-96d7-582e25a78e9a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7cb72d1-d02c-4194-85dd-9651c27b73c3 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:03 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1930ac72-729d-4b89-b614-b95c9899f790 tempest-VolumeDependencyTests-651483409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.f3a17353-03d6-48f3-8991-8ad97fecb94c" returned: 0 in 0.502s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1930ac72-729d-4b89-b614-b95c9899f790 tempest-VolumeDependencyTests-651483409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.f3a17353-03d6-48f3-8991-8ad97fecb94c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:03 devstack sudo[106871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.f3a17353-03d6-48f3-8991-8ad97fecb94c
Nov 05 15:23:03 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:03 devstack sudo[106870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a
Nov 05 15:23:03 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:03 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1930ac72-729d-4b89-b614-b95c9899f790 tempest-VolumeDependencyTests-651483409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f.f3a17353-03d6-48f3-8991-8ad97fecb94c" returned: 0 in 0.298s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1930ac72-729d-4b89-b614-b95c9899f790 tempest-VolumeDependencyTests-651483409 None] Lock "cinder-quobyte-f3a17353-03d6-48f3-8991-8ad97fecb94c" released by "_delete_snapshot" :: held 2.067s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:03 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7cb72d1-d02c-4194-85dd-9651c27b73c3 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a" returned: 0 in 0.444s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7cb72d1-d02c-4194-85dd-9651c27b73c3 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.6c96f264-5446-4c0c-a122-fdb1ab4b6701 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1930ac72-729d-4b89-b614-b95c9899f790 tempest-VolumeDependencyTests-651483409 None] Lock "cinder-quobyte-463bed9e-f856-4458-9771-1aae42a44d6f" released by "delete_snapshot" :: held 2.101s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:03 devstack sudo[106878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.6c96f264-5446-4c0c-a122-fdb1ab4b6701 1G
Nov 05 15:23:03 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-1930ac72-729d-4b89-b614-b95c9899f790 tempest-VolumeDependencyTests-651483409 None] Created reservations ['ac1170fd-a0dc-4877-a61f-f198a270f2df', '25b7b124-2a71-4747-adba-a9dad7ba9290', '8d641cc1-c0ea-452c-8653-d1f4dd0587a4', '8443815d-0f6e-42bf-a183-5621b32d70e2'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1930ac72-729d-4b89-b614-b95c9899f790 tempest-VolumeDependencyTests-651483409 None] Delete snapshot completed successfully.
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1930ac72-729d-4b89-b614-b95c9899f790 tempest-VolumeDependencyTests-651483409 None] Lock "cinder-f3a17353-03d6-48f3-8991-8ad97fecb94c-delete_snapshot" released by "delete_snapshot" :: held 2.258s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fda7d2b4-f5e9-46d9-b491-ca4b920468cc tempest-VolumeDependencyTests-651483409 None] Acquiring lock "cinder-463bed9e-f856-4458-9771-1aae42a44d6f-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fda7d2b4-f5e9-46d9-b491-ca4b920468cc tempest-VolumeDependencyTests-651483409 None] Lock "cinder-463bed9e-f856-4458-9771-1aae42a44d6f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fda7d2b4-f5e9-46d9-b491-ca4b920468cc tempest-VolumeDependencyTests-651483409 None] Acquiring lock "cinder-quobyte-463bed9e-f856-4458-9771-1aae42a44d6f" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fda7d2b4-f5e9-46d9-b491-ca4b920468cc tempest-VolumeDependencyTests-651483409 None] Lock "cinder-quobyte-463bed9e-f856-4458-9771-1aae42a44d6f" acquired by "delete_volume" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc152b21-43a9-43b1-b255-ba233071d307]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fda7d2b4-f5e9-46d9-b491-ca4b920468cc tempest-VolumeDependencyTests-651483409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:04 devstack sudo[106883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f
Nov 05 15:23:04 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:04 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7cb72d1-d02c-4194-85dd-9651c27b73c3 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.6c96f264-5446-4c0c-a122-fdb1ab4b6701 1G" returned: 0 in 0.531s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7cb72d1-d02c-4194-85dd-9651c27b73c3 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e408950c-45a7-444b-8e0d-641f507a5d0a -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.6c96f264-5446-4c0c-a122-fdb1ab4b6701 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:04 devstack sudo[106886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e408950c-45a7-444b-8e0d-641f507a5d0a -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.6c96f264-5446-4c0c-a122-fdb1ab4b6701
Nov 05 15:23:04 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:04 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fda7d2b4-f5e9-46d9-b491-ca4b920468cc tempest-VolumeDependencyTests-651483409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f" returned: 0 in 0.451s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fda7d2b4-f5e9-46d9-b491-ca4b920468cc tempest-VolumeDependencyTests-651483409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:04 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:04 devstack sudo[106894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7cb72d1-d02c-4194-85dd-9651c27b73c3 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e408950c-45a7-444b-8e0d-641f507a5d0a -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.6c96f264-5446-4c0c-a122-fdb1ab4b6701" returned: 0 in 0.310s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:04 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-b7cb72d1-d02c-4194-85dd-9651c27b73c3 tempest-ProjectMemberTests-340429542 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.6c96f264-5446-4c0c-a122-fdb1ab4b6701 is being set with open permissions: ugo+rw
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7cb72d1-d02c-4194-85dd-9651c27b73c3 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.6c96f264-5446-4c0c-a122-fdb1ab4b6701 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:04 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:04 devstack sudo[106896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.6c96f264-5446-4c0c-a122-fdb1ab4b6701
Nov 05 15:23:04 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Flow 'volume_create_manager' (73cbf742-9eeb-43ad-bf61-bbd0ec93e4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5efcce46-8e0b-4e96-b86a-8208e24cbcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5efcce46-8e0b-4e96-b86a-8208e24cbcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-733638794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f884c94-c827-485a-acfa-709349910422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962e4e5cd68c455a965f7e07e9a854e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:04Z,use_quota=True,user_id='4cf7b69fb0444b9d868c64c44ede0c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (336be561-52bb-4607-becd-1ce7b6488e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (336be561-52bb-4607-becd-1ce7b6488e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52fd6da-65c1-4761-a595-59fb3d102499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52fd6da-65c1-4761-a595-59fb3d102499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f884c94-c827-485a-acfa-709349910422', 'volume_name': 'volume-0f884c94-c827-485a-acfa-709349910422', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (967d0b2b-c225-419a-8374-4b307a4f7e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (967d0b2b-c225-419a-8374-4b307a4f7e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e04265a-6621-4b9b-bbba-153622a0a385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:04 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Volume 0f884c94-c827-485a-acfa-709349910422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f884c94-c827-485a-acfa-709349910422', 'volume_size': 1}
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:04 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fda7d2b4-f5e9-46d9-b491-ca4b920468cc tempest-VolumeDependencyTests-651483409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-463bed9e-f856-4458-9771-1aae42a44d6f" returned: 0 in 0.260s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fda7d2b4-f5e9-46d9-b491-ca4b920468cc tempest-VolumeDependencyTests-651483409 None] Lock "cinder-quobyte-463bed9e-f856-4458-9771-1aae42a44d6f" released by "delete_volume" :: held 0.782s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:04 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7cb72d1-d02c-4194-85dd-9651c27b73c3 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.6c96f264-5446-4c0c-a122-fdb1ab4b6701" returned: 0 in 0.265s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7cb72d1-d02c-4194-85dd-9651c27b73c3 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:04 devstack sudo[106900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.info
Nov 05 15:23:04 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-fda7d2b4-f5e9-46d9-b491-ca4b920468cc tempest-VolumeDependencyTests-651483409 None] Created reservations ['4941bd15-db1c-4a7f-a67d-6a08b89bcd6e', '04d487bd-8f36-40e5-935f-46119ddd6821', '8f65cbdf-4333-4dbc-bd3e-6492207ca83e', '3a9fdb7c-b5cf-421e-b7d6-bfca2ada630c'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fda7d2b4-f5e9-46d9-b491-ca4b920468cc tempest-VolumeDependencyTests-651483409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fda7d2b4-f5e9-46d9-b491-ca4b920468cc tempest-VolumeDependencyTests-651483409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fda7d2b4-f5e9-46d9-b491-ca4b920468cc tempest-VolumeDependencyTests-651483409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fda7d2b4-f5e9-46d9-b491-ca4b920468cc tempest-VolumeDependencyTests-651483409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fda7d2b4-f5e9-46d9-b491-ca4b920468cc tempest-VolumeDependencyTests-651483409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fda7d2b4-f5e9-46d9-b491-ca4b920468cc tempest-VolumeDependencyTests-651483409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:04 devstack sudo[106902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:23:04 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:04 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7cb72d1-d02c-4194-85dd-9651c27b73c3 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.info" returned: 0 in 0.278s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:04 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-b7cb72d1-d02c-4194-85dd-9651c27b73c3 tempest-ProjectMemberTests-340429542 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.info is being set with open permissions: ugo+rw
Nov 05 15:23:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7cb72d1-d02c-4194-85dd-9651c27b73c3 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:05 devstack sudo[106905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.info
Nov 05 15:23:05 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:05 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bdb24fc6-bf1e-4272-bd2c-0ae0c6ffbd60 tempest-VolumeDependencyTests-651483409 None] Acquiring lock "cinder-af49286c-1193-4872-a019-f2a3d27c6df3-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fda7d2b4-f5e9-46d9-b491-ca4b920468cc tempest-VolumeDependencyTests-651483409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.272s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-fda7d2b4-f5e9-46d9-b491-ca4b920468cc tempest-VolumeDependencyTests-651483409 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:23:05 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-fda7d2b4-f5e9-46d9-b491-ca4b920468cc tempest-VolumeDependencyTests-651483409 None] Deleted volume successfully.
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bdb24fc6-bf1e-4272-bd2c-0ae0c6ffbd60 tempest-VolumeDependencyTests-651483409 None] Lock "cinder-af49286c-1193-4872-a019-f2a3d27c6df3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fda7d2b4-f5e9-46d9-b491-ca4b920468cc tempest-VolumeDependencyTests-651483409 None] Lock "cinder-463bed9e-f856-4458-9771-1aae42a44d6f-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bdb24fc6-bf1e-4272-bd2c-0ae0c6ffbd60 tempest-VolumeDependencyTests-651483409 None] Acquiring lock "cinder-quobyte-af49286c-1193-4872-a019-f2a3d27c6df3" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bdb24fc6-bf1e-4272-bd2c-0ae0c6ffbd60 tempest-VolumeDependencyTests-651483409 None] Lock "cinder-quobyte-af49286c-1193-4872-a019-f2a3d27c6df3" acquired by "delete_volume" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea04055-73e3-40f5-af26-6a8fc03cf838]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bdb24fc6-bf1e-4272-bd2c-0ae0c6ffbd60 tempest-VolumeDependencyTests-651483409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af49286c-1193-4872-a019-f2a3d27c6df3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:05 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7cb72d1-d02c-4194-85dd-9651c27b73c3 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.info" returned: 0 in 0.269s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b7cb72d1-d02c-4194-85dd-9651c27b73c3 tempest-ProjectMemberTests-340429542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.261s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.152s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1276019682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95df3bfd-367b-42e8-b66d-9ced5028ea8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df1caec296c4850896ffa28c7b7d2b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:03Z,use_quota=True,user_id='545c323e4c124ff1b081df240c8a6522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Creating volume 95df3bfd-367b-42e8-b66d-9ced5028ea8b {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:23:05 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:05 devstack sudo[106908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af49286c-1193-4872-a019-f2a3d27c6df3
Nov 05 15:23:05 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:05 devstack sudo[106911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b 1073741824
Nov 05 15:23:05 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:05 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b7cb72d1-d02c-4194-85dd-9651c27b73c3 tempest-ProjectMemberTests-340429542 None] Create snapshot completed successfully
Nov 05 15:23:05 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bdb24fc6-bf1e-4272-bd2c-0ae0c6ffbd60 tempest-VolumeDependencyTests-651483409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af49286c-1193-4872-a019-f2a3d27c6df3" returned: 0 in 0.381s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bdb24fc6-bf1e-4272-bd2c-0ae0c6ffbd60 tempest-VolumeDependencyTests-651483409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af49286c-1193-4872-a019-f2a3d27c6df3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:05 devstack sudo[106919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af49286c-1193-4872-a019-f2a3d27c6df3
Nov 05 15:23:05 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:05 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b 1073741824" returned: 0 in 0.441s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:05 devstack sudo[106922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b
Nov 05 15:23:05 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:05 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bdb24fc6-bf1e-4272-bd2c-0ae0c6ffbd60 tempest-VolumeDependencyTests-651483409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-af49286c-1193-4872-a019-f2a3d27c6df3" returned: 0 in 0.261s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bdb24fc6-bf1e-4272-bd2c-0ae0c6ffbd60 tempest-VolumeDependencyTests-651483409 None] Lock "cinder-quobyte-af49286c-1193-4872-a019-f2a3d27c6df3" released by "delete_volume" :: held 0.682s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-bdb24fc6-bf1e-4272-bd2c-0ae0c6ffbd60 tempest-VolumeDependencyTests-651483409 None] Created reservations ['0511c91b-4ef8-42a9-9f39-c9ce9391aef6', '9d901c59-01ed-4e05-8270-4d219b0699c1', 'cdaa356a-2094-4019-8bf8-528819ed99f0', '15e242c6-928c-43ec-80ae-563cefd50bb2'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bdb24fc6-bf1e-4272-bd2c-0ae0c6ffbd60 tempest-VolumeDependencyTests-651483409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bdb24fc6-bf1e-4272-bd2c-0ae0c6ffbd60 tempest-VolumeDependencyTests-651483409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bdb24fc6-bf1e-4272-bd2c-0ae0c6ffbd60 tempest-VolumeDependencyTests-651483409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bdb24fc6-bf1e-4272-bd2c-0ae0c6ffbd60 tempest-VolumeDependencyTests-651483409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bdb24fc6-bf1e-4272-bd2c-0ae0c6ffbd60 tempest-VolumeDependencyTests-651483409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bdb24fc6-bf1e-4272-bd2c-0ae0c6ffbd60 tempest-VolumeDependencyTests-651483409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:05 devstack sudo[106925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:23:05 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:06 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b" returned: 0 in 0.267s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.415s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-733638794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f884c94-c827-485a-acfa-709349910422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962e4e5cd68c455a965f7e07e9a854e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:04Z,use_quota=True,user_id='4cf7b69fb0444b9d868c64c44ede0c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Creating volume 0f884c94-c827-485a-acfa-709349910422 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:23:06 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0f884c94-c827-485a-acfa-709349910422 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111a4349-e42d-4081-a23c-16afe073a955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e824227f-2b23-4d97-9021-014d30d0deae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:06 devstack sudo[106928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0f884c94-c827-485a-acfa-709349910422 1073741824
Nov 05 15:23:06 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:06 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Volume volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b (95df3bfd-367b-42e8-b66d-9ced5028ea8b): created successfully
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e824227f-2b23-4d97-9021-014d30d0deae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Flow 'volume_create_manager' (b2b63e83-f4ea-4c5e-99e8-8d7e4f829542) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2036b8e8-6f4d-4da2-b9ce-d2a26e0b0c93 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-6c96f264-5446-4c0c-a122-fdb1ab4b6701-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0ae5c48b-d8f0-4b0a-8efa-027c527804d7 tempest-CreateVolumesFromSnapshotTest-501279056 None] Created volume successfully.
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2036b8e8-6f4d-4da2-b9ce-d2a26e0b0c93 tempest-ProjectMemberTests-340429542 None] Lock "cinder-6c96f264-5446-4c0c-a122-fdb1ab4b6701-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2036b8e8-6f4d-4da2-b9ce-d2a26e0b0c93 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-e408950c-45a7-444b-8e0d-641f507a5d0a" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2036b8e8-6f4d-4da2-b9ce-d2a26e0b0c93 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-e408950c-45a7-444b-8e0d-641f507a5d0a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2036b8e8-6f4d-4da2-b9ce-d2a26e0b0c93 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-6c96f264-5446-4c0c-a122-fdb1ab4b6701" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2036b8e8-6f4d-4da2-b9ce-d2a26e0b0c93 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-6c96f264-5446-4c0c-a122-fdb1ab4b6701" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-2036b8e8-6f4d-4da2-b9ce-d2a26e0b0c93 tempest-ProjectMemberTests-340429542 None] Deleting offline snapshot 6c96f264-5446-4c0c-a122-fdb1ab4b6701 of volume e408950c-45a7-444b-8e0d-641f507a5d0a {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-2036b8e8-6f4d-4da2-b9ce-d2a26e0b0c93 tempest-ProjectMemberTests-340429542 None] snapshot_file for this snap is: volume-e408950c-45a7-444b-8e0d-641f507a5d0a.6c96f264-5446-4c0c-a122-fdb1ab4b6701 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:23:06 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bdb24fc6-bf1e-4272-bd2c-0ae0c6ffbd60 tempest-VolumeDependencyTests-651483409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.319s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-bdb24fc6-bf1e-4272-bd2c-0ae0c6ffbd60 tempest-VolumeDependencyTests-651483409 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:23:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-bdb24fc6-bf1e-4272-bd2c-0ae0c6ffbd60 tempest-VolumeDependencyTests-651483409 None] Deleted volume successfully.
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc8ea65-d7d6-4091-8f32-b27162db8f15]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2036b8e8-6f4d-4da2-b9ce-d2a26e0b0c93 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.6c96f264-5446-4c0c-a122-fdb1ab4b6701 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bdb24fc6-bf1e-4272-bd2c-0ae0c6ffbd60 tempest-VolumeDependencyTests-651483409 None] Lock "cinder-af49286c-1193-4872-a019-f2a3d27c6df3-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:06 devstack sudo[106931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.6c96f264-5446-4c0c-a122-fdb1ab4b6701
Nov 05 15:23:06 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:06 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0f884c94-c827-485a-acfa-709349910422 1073741824" returned: 0 in 0.516s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0f884c94-c827-485a-acfa-709349910422 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:06 devstack sudo[106936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0f884c94-c827-485a-acfa-709349910422
Nov 05 15:23:06 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:06 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2036b8e8-6f4d-4da2-b9ce-d2a26e0b0c93 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.6c96f264-5446-4c0c-a122-fdb1ab4b6701" returned: 0 in 0.425s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-2036b8e8-6f4d-4da2-b9ce-d2a26e0b0c93 tempest-ProjectMemberTests-340429542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e408950c-45a7-444b-8e0d-641f507a5d0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[196becd1-2c55-4721-9437-c9ed75456034]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2036b8e8-6f4d-4da2-b9ce-d2a26e0b0c93 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:06 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0f884c94-c827-485a-acfa-709349910422" returned: 0 in 0.266s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:06 devstack sudo[106941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a
Nov 05 15:23:06 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e04265a-6621-4b9b-bbba-153622a0a385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f884c94-c827-485a-acfa-709349910422', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af36db26-75d7-4f48-bc81-093effe87cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:06 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Volume volume-0f884c94-c827-485a-acfa-709349910422 (0f884c94-c827-485a-acfa-709349910422): created successfully
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af36db26-75d7-4f48-bc81-093effe87cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Flow 'volume_create_manager' (73cbf742-9eeb-43ad-bf61-bbd0ec93e4a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5eb6860f-84ae-4c12-82cf-12afe1624684 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Created volume successfully.
Nov 05 15:23:07 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2036b8e8-6f4d-4da2-b9ce-d2a26e0b0c93 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a" returned: 0 in 0.419s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2036b8e8-6f4d-4da2-b9ce-d2a26e0b0c93 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.6c96f264-5446-4c0c-a122-fdb1ab4b6701 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:07 devstack sudo[106947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.6c96f264-5446-4c0c-a122-fdb1ab4b6701
Nov 05 15:23:07 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-20ff8f28-8bad-4c16-b385-71bc746e7faf tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-20ff8f28-8bad-4c16-b385-71bc746e7faf tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-20ff8f28-8bad-4c16-b385-71bc746e7faf tempest-CreateVolumesFromSnapshotTest-501279056 None] Creating offline snapshot 2f37c871-8d22-469f-8932-4fb98fd04a2e of volume 95df3bfd-367b-42e8-b66d-9ced5028ea8b {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:23:07 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fe5249-0df4-4b1d-bd5a-5e41fdb18af9]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20ff8f28-8bad-4c16-b385-71bc746e7faf tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:07 devstack sudo[106949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b
Nov 05 15:23:07 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:07 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2036b8e8-6f4d-4da2-b9ce-d2a26e0b0c93 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.6c96f264-5446-4c0c-a122-fdb1ab4b6701" returned: 0 in 0.422s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2036b8e8-6f4d-4da2-b9ce-d2a26e0b0c93 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.6c96f264-5446-4c0c-a122-fdb1ab4b6701 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:07 devstack sudo[106955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.6c96f264-5446-4c0c-a122-fdb1ab4b6701
Nov 05 15:23:07 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:07 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20ff8f28-8bad-4c16-b385-71bc746e7faf tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b" returned: 0 in 0.496s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20ff8f28-8bad-4c16-b385-71bc746e7faf tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.2f37c871-8d22-469f-8932-4fb98fd04a2e 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:07 devstack sudo[106960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.2f37c871-8d22-469f-8932-4fb98fd04a2e 1G
Nov 05 15:23:07 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:08 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2036b8e8-6f4d-4da2-b9ce-d2a26e0b0c93 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a.6c96f264-5446-4c0c-a122-fdb1ab4b6701" returned: 0 in 0.422s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2036b8e8-6f4d-4da2-b9ce-d2a26e0b0c93 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-6c96f264-5446-4c0c-a122-fdb1ab4b6701" released by "_delete_snapshot" :: held 1.880s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2036b8e8-6f4d-4da2-b9ce-d2a26e0b0c93 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-e408950c-45a7-444b-8e0d-641f507a5d0a" released by "delete_snapshot" :: held 1.910s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-2036b8e8-6f4d-4da2-b9ce-d2a26e0b0c93 tempest-ProjectMemberTests-340429542 None] Created reservations ['ca2d4a23-436d-42d7-830a-0022c71d8837', '64235916-2f1a-435f-8b0b-1d75a8c4258e', '1d1423e7-0a19-4dce-a6d1-30fa9c2a27f5', '58c31dff-c294-4773-baed-65d139bf0c9b'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:08 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2036b8e8-6f4d-4da2-b9ce-d2a26e0b0c93 tempest-ProjectMemberTests-340429542 None] Delete snapshot completed successfully.
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2036b8e8-6f4d-4da2-b9ce-d2a26e0b0c93 tempest-ProjectMemberTests-340429542 None] Lock "cinder-6c96f264-5446-4c0c-a122-fdb1ab4b6701-delete_snapshot" released by "delete_snapshot" :: held 2.135s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Flow 'volume_create_manager' (b9bf716e-4a60-467d-a3de-72f05661aa5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4327369-8d48-4469-be39-ea6e47ee19f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4327369-8d48-4469-be39-ea6e47ee19f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1501132731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5917964-3c9e-41cc-a3a3-b10717c432ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962e4e5cd68c455a965f7e07e9a854e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:08Z,use_quota=True,user_id='4cf7b69fb0444b9d868c64c44ede0c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e321e3a7-15d2-4452-95cd-4354d808c603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:08 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e321e3a7-15d2-4452-95cd-4354d808c603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b6b488-7192-4d5e-b59d-7939a0c92ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b6b488-7192-4d5e-b59d-7939a0c92ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5917964-3c9e-41cc-a3a3-b10717c432ac', 'volume_name': 'volume-b5917964-3c9e-41cc-a3a3-b10717c432ac', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1a497e-c07a-471e-a0fe-ee1e286226bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1a497e-c07a-471e-a0fe-ee1e286226bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68640dfa-67d0-4596-9ce2-5ae7850506c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:08 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Volume b5917964-3c9e-41cc-a3a3-b10717c432ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5917964-3c9e-41cc-a3a3-b10717c432ac', 'volume_size': 1}
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-873a0ac7-afaa-4353-918f-213a9337ae47 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-e408950c-45a7-444b-8e0d-641f507a5d0a-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20ff8f28-8bad-4c16-b385-71bc746e7faf tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.2f37c871-8d22-469f-8932-4fb98fd04a2e 1G" returned: 0 in 0.657s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20ff8f28-8bad-4c16-b385-71bc746e7faf tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.2f37c871-8d22-469f-8932-4fb98fd04a2e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-873a0ac7-afaa-4353-918f-213a9337ae47 tempest-ProjectMemberTests-340429542 None] Lock "cinder-e408950c-45a7-444b-8e0d-641f507a5d0a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:08 devstack sudo[106966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.2f37c871-8d22-469f-8932-4fb98fd04a2e
Nov 05 15:23:08 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-873a0ac7-afaa-4353-918f-213a9337ae47 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-e408950c-45a7-444b-8e0d-641f507a5d0a" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-873a0ac7-afaa-4353-918f-213a9337ae47 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-e408950c-45a7-444b-8e0d-641f507a5d0a" acquired by "delete_volume" :: waited 0.024s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e12704a-56d3-4fee-8408-ccf7002e8b9a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-873a0ac7-afaa-4353-918f-213a9337ae47 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:08 devstack sudo[106968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a
Nov 05 15:23:08 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:08 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20ff8f28-8bad-4c16-b385-71bc746e7faf tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.2f37c871-8d22-469f-8932-4fb98fd04a2e" returned: 0 in 0.420s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:08 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-20ff8f28-8bad-4c16-b385-71bc746e7faf tempest-CreateVolumesFromSnapshotTest-501279056 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.2f37c871-8d22-469f-8932-4fb98fd04a2e is being set with open permissions: ugo+rw
Nov 05 15:23:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20ff8f28-8bad-4c16-b385-71bc746e7faf tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.2f37c871-8d22-469f-8932-4fb98fd04a2e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Flow 'volume_create_manager' (c8033cb4-c6eb-4848-a19c-cf8dc0a29cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:09 devstack sudo[106974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.2f37c871-8d22-469f-8932-4fb98fd04a2e
Nov 05 15:23:09 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ab4b7b-f06b-4dac-b2f3-04fd3573e27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ab4b7b-f06b-4dac-b2f3-04fd3573e27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1044675965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a3f0df-8b30-45d2-b76f-194d4d57552f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962e4e5cd68c455a965f7e07e9a854e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:09Z,use_quota=True,user_id='4cf7b69fb0444b9d868c64c44ede0c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e487c0ad-2e6f-49bd-ba72-2164c2c7a9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e487c0ad-2e6f-49bd-ba72-2164c2c7a9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac626da-2495-4812-8feb-f656be00a08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac626da-2495-4812-8feb-f656be00a08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8a3f0df-8b30-45d2-b76f-194d4d57552f', 'volume_name': 'volume-d8a3f0df-8b30-45d2-b76f-194d4d57552f', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b14b65e3-964f-4864-bd96-c95f5f37c0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b14b65e3-964f-4864-bd96-c95f5f37c0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08dddbb9-62db-4cf0-a3a8-5be9f85594ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:09 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Volume d8a3f0df-8b30-45d2-b76f-194d4d57552f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8a3f0df-8b30-45d2-b76f-194d4d57552f', 'volume_size': 1}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:09 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-873a0ac7-afaa-4353-918f-213a9337ae47 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a" returned: 0 in 0.591s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-873a0ac7-afaa-4353-918f-213a9337ae47 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:09 devstack sudo[106981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a
Nov 05 15:23:09 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:09 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20ff8f28-8bad-4c16-b385-71bc746e7faf tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.2f37c871-8d22-469f-8932-4fb98fd04a2e" returned: 0 in 0.414s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20ff8f28-8bad-4c16-b385-71bc746e7faf tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:23:09 devstack sudo[106983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.info
Nov 05 15:23:09 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Flow 'volume_create_manager' (2d5b4f13-8be3-4ea7-9356-4f964b305043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50055d72-7f4c-471a-94ca-bb7ab4855bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50055d72-7f4c-471a-94ca-bb7ab4855bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1178717496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ed5822-cf1f-4925-81e0-bf183c48df80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962e4e5cd68c455a965f7e07e9a854e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:09Z,use_quota=True,user_id='4cf7b69fb0444b9d868c64c44ede0c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a809f752-5d68-4b52-9cf6-c3534d4d4486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a809f752-5d68-4b52-9cf6-c3534d4d4486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f8e644-bec2-4423-b488-f84cda4a7c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f8e644-bec2-4423-b488-f84cda4a7c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22ed5822-cf1f-4925-81e0-bf183c48df80', 'volume_name': 'volume-22ed5822-cf1f-4925-81e0-bf183c48df80', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c0f694b-8d7b-4aa9-acca-4fa98a97eed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c0f694b-8d7b-4aa9-acca-4fa98a97eed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3545d746-ea52-45d0-84a9-5cbedb472990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:09 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Volume 22ed5822-cf1f-4925-81e0-bf183c48df80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22ed5822-cf1f-4925-81e0-bf183c48df80', 'volume_size': 1}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:09 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-873a0ac7-afaa-4353-918f-213a9337ae47 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-e408950c-45a7-444b-8e0d-641f507a5d0a" returned: 0 in 0.462s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:09 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-873a0ac7-afaa-4353-918f-213a9337ae47 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-e408950c-45a7-444b-8e0d-641f507a5d0a" released by "delete_volume" :: held 1.160s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20ff8f28-8bad-4c16-b385-71bc746e7faf tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.info" returned: 0 in 0.396s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:09 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-20ff8f28-8bad-4c16-b385-71bc746e7faf tempest-CreateVolumesFromSnapshotTest-501279056 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.info is being set with open permissions: ugo+rw
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20ff8f28-8bad-4c16-b385-71bc746e7faf tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:09 devstack sudo[106987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.info
Nov 05 15:23:09 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Flow 'volume_create_manager' (99f87c6c-9cd5-44c9-af15-91ee29d2fb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c17cf1-f95d-4a4d-8646-d7728ae2dbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c17cf1-f95d-4a4d-8646-d7728ae2dbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-345522893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10fbccf5-a96b-49ab-b73a-7c3df0d73dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962e4e5cd68c455a965f7e07e9a854e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:10Z,use_quota=True,user_id='4cf7b69fb0444b9d868c64c44ede0c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6321db-2409-4dd0-b8c1-7aa453b89a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6321db-2409-4dd0-b8c1-7aa453b89a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78943176-cd97-4b70-9605-51a1d0f1ad53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78943176-cd97-4b70-9605-51a1d0f1ad53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10fbccf5-a96b-49ab-b73a-7c3df0d73dd1', 'volume_name': 'volume-10fbccf5-a96b-49ab-b73a-7c3df0d73dd1', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48210893-d7d3-4bf8-b863-b05a7c6b17a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48210893-d7d3-4bf8-b863-b05a7c6b17a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748967d3-46f1-4e6e-8dac-d3b56f581066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:10 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Volume 10fbccf5-a96b-49ab-b73a-7c3df0d73dd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10fbccf5-a96b-49ab-b73a-7c3df0d73dd1', 'volume_size': 1}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-873a0ac7-afaa-4353-918f-213a9337ae47 tempest-ProjectMemberTests-340429542 None] Created reservations ['9b898fc0-ab90-4692-92d6-58788ac456af', 'e169932b-757d-4f8d-ab7c-d12d7de3d3b4', '0f4b1659-f72c-4933-b387-d208a07e535f', 'fa93a788-0fb1-4bd5-898d-1ef7ce69b999'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-873a0ac7-afaa-4353-918f-213a9337ae47 tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-873a0ac7-afaa-4353-918f-213a9337ae47 tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-873a0ac7-afaa-4353-918f-213a9337ae47 tempest-ProjectMemberTests-340429542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-873a0ac7-afaa-4353-918f-213a9337ae47 tempest-ProjectMemberTests-340429542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-873a0ac7-afaa-4353-918f-213a9337ae47 tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-873a0ac7-afaa-4353-918f-213a9337ae47 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:10 devstack sudo[106990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:23:10 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:10 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20ff8f28-8bad-4c16-b385-71bc746e7faf tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.info" returned: 0 in 0.352s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-20ff8f28-8bad-4c16-b385-71bc746e7faf tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.867s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.679s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1501132731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5917964-3c9e-41cc-a3a3-b10717c432ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962e4e5cd68c455a965f7e07e9a854e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:08Z,use_quota=True,user_id='4cf7b69fb0444b9d868c64c44ede0c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Creating volume b5917964-3c9e-41cc-a3a3-b10717c432ac {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:23:10 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b5917964-3c9e-41cc-a3a3-b10717c432ac 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:10 devstack sudo[106992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b5917964-3c9e-41cc-a3a3-b10717c432ac 1073741824
Nov 05 15:23:10 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:10 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-20ff8f28-8bad-4c16-b385-71bc746e7faf tempest-CreateVolumesFromSnapshotTest-501279056 None] Create snapshot completed successfully
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Flow 'volume_create_manager' (d1886bf1-ba0e-4a52-a347-0837b6b9736b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610685cd-5395-4b8b-8752-1ea63df43a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610685cd-5395-4b8b-8752-1ea63df43a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1876011860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74fa2174-9848-4344-99fa-588149b48cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962e4e5cd68c455a965f7e07e9a854e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:10Z,use_quota=True,user_id='4cf7b69fb0444b9d868c64c44ede0c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7708fa-e4e5-4ab0-91fd-18e033006598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7708fa-e4e5-4ab0-91fd-18e033006598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c21623-17a4-4b4f-a1d5-4c8c182f6f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c21623-17a4-4b4f-a1d5-4c8c182f6f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74fa2174-9848-4344-99fa-588149b48cb9', 'volume_name': 'volume-74fa2174-9848-4344-99fa-588149b48cb9', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c83f4c8-e78e-49b2-a7f5-022e052bc7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c83f4c8-e78e-49b2-a7f5-022e052bc7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88abf709-6a04-4753-9bb2-497c2758751c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:10 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Volume 74fa2174-9848-4344-99fa-588149b48cb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74fa2174-9848-4344-99fa-588149b48cb9', 'volume_size': 1}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:10 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-873a0ac7-afaa-4353-918f-213a9337ae47 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.295s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-873a0ac7-afaa-4353-918f-213a9337ae47 tempest-ProjectMemberTests-340429542 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:23:10 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-873a0ac7-afaa-4353-918f-213a9337ae47 tempest-ProjectMemberTests-340429542 None] Deleted volume successfully.
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-873a0ac7-afaa-4353-918f-213a9337ae47 tempest-ProjectMemberTests-340429542 None] Lock "cinder-e408950c-45a7-444b-8e0d-641f507a5d0a-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:10 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b5917964-3c9e-41cc-a3a3-b10717c432ac 1073741824" returned: 0 in 0.590s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b5917964-3c9e-41cc-a3a3-b10717c432ac {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:10 devstack sudo[106999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b5917964-3c9e-41cc-a3a3-b10717c432ac
Nov 05 15:23:10 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Flow 'volume_create_manager' (fa1db610-12b6-44de-856d-dd6c4eb392cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d844cc2-8332-423d-9d04-8535c2773f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:11 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d844cc2-8332-423d-9d04-8535c2773f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-976459245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8751b2-abbe-49ca-bd4e-b02d037d06c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df1caec296c4850896ffa28c7b7d2b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:11Z,use_quota=True,user_id='545c323e4c124ff1b081df240c8a6522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbeb54b7-0bae-473c-bd8f-141ba9b14cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbeb54b7-0bae-473c-bd8f-141ba9b14cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5c3870-3e9b-4978-9380-a63ac892a93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5c3870-3e9b-4978-9380-a63ac892a93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f8751b2-abbe-49ca-bd4e-b02d037d06c0', 'volume_name': 'volume-7f8751b2-abbe-49ca-bd4e-b02d037d06c0', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d257a8f7-c129-4001-9d94-da85ee55707b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d257a8f7-c129-4001-9d94-da85ee55707b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c368dede-4a5d-4601-b959-212dc810f59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:11 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Volume 7f8751b2-abbe-49ca-bd4e-b02d037d06c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f8751b2-abbe-49ca-bd4e-b02d037d06c0', 'volume_size': 1}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b5917964-3c9e-41cc-a3a3-b10717c432ac" returned: 0 in 0.488s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.248s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1044675965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a3f0df-8b30-45d2-b76f-194d4d57552f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962e4e5cd68c455a965f7e07e9a854e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:09Z,use_quota=True,user_id='4cf7b69fb0444b9d868c64c44ede0c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Creating volume d8a3f0df-8b30-45d2-b76f-194d4d57552f {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:23:11 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d8a3f0df-8b30-45d2-b76f-194d4d57552f 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68640dfa-67d0-4596-9ce2-5ae7850506c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5917964-3c9e-41cc-a3a3-b10717c432ac', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db735867-6abe-44f4-9b6d-b4a08f45b546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:11 devstack sudo[107002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d8a3f0df-8b30-45d2-b76f-194d4d57552f 1073741824
Nov 05 15:23:11 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:11 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Volume volume-b5917964-3c9e-41cc-a3a3-b10717c432ac (b5917964-3c9e-41cc-a3a3-b10717c432ac): created successfully
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db735867-6abe-44f4-9b6d-b4a08f45b546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Flow 'volume_create_manager' (b9bf716e-4a60-467d-a3de-72f05661aa5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:11 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-740e92d2-c41a-4540-b434-66f1b2a222fb tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Created volume successfully.
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Flow 'volume_create_manager' (4eaea9b9-dbf5-46d6-9dc5-8a851fafa582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2142c5-9ecc-4843-9df3-b58701e23510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2142c5-9ecc-4843-9df3-b58701e23510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-911832791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=642e2e22-ad3e-4317-9d10-a49f23436716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9e03f4a164bf48042da27edfd742d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:12Z,use_quota=True,user_id='d3585054b64542a1a174061b1731d371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a55f3f-2c83-4242-a39f-93587ec92e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a55f3f-2c83-4242-a39f-93587ec92e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39042464-33ea-4596-af58-c926ed20c964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39042464-33ea-4596-af58-c926ed20c964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '642e2e22-ad3e-4317-9d10-a49f23436716', 'volume_name': 'volume-642e2e22-ad3e-4317-9d10-a49f23436716', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa443770-e941-4dbe-a8cc-c8c1e6478679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa443770-e941-4dbe-a8cc-c8c1e6478679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf3296ce-fa87-4867-a52a-7dc96cde6655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:11 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Volume 642e2e22-ad3e-4317-9d10-a49f23436716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-642e2e22-ad3e-4317-9d10-a49f23436716', 'volume_size': 1}
Nov 05 15:23:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Flow 'volume_create_manager' (5ca7047a-f746-411e-bd47-1a0010722732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aba7e11-d30f-4496-9bf2-39ea14ecc50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aba7e11-d30f-4496-9bf2-39ea14ecc50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-380485472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb01e94-abd5-43df-a4fc-d31149610267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df1caec296c4850896ffa28c7b7d2b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:12Z,use_quota=True,user_id='545c323e4c124ff1b081df240c8a6522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46def8cb-baf0-40c2-af5d-bb2e763ebfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46def8cb-baf0-40c2-af5d-bb2e763ebfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb39ce74-5399-46fe-b760-8253550c9853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb39ce74-5399-46fe-b760-8253550c9853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcb01e94-abd5-43df-a4fc-d31149610267', 'volume_name': 'volume-fcb01e94-abd5-43df-a4fc-d31149610267', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fbb91f7-9434-412b-af14-28949d00654f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fbb91f7-9434-412b-af14-28949d00654f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e3a0d8-2ec3-4fbe-88d8-50e457fe04c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:12 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Volume fcb01e94-abd5-43df-a4fc-d31149610267: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcb01e94-abd5-43df-a4fc-d31149610267', 'volume_size': 1}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:12 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d8a3f0df-8b30-45d2-b76f-194d4d57552f 1073741824" returned: 0 in 0.756s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d8a3f0df-8b30-45d2-b76f-194d4d57552f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:12 devstack sudo[107008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d8a3f0df-8b30-45d2-b76f-194d4d57552f
Nov 05 15:23:12 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Flow 'volume_create_manager' (e7231abd-dfd1-43d9-bb8a-4d161a815355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d045aefb-7baa-4223-bbc7-b9550a0c4e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d045aefb-7baa-4223-bbc7-b9550a0c4e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-866077799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3946995-df9f-42c4-ae9c-0b88ac23b69d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df1caec296c4850896ffa28c7b7d2b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:12Z,use_quota=True,user_id='545c323e4c124ff1b081df240c8a6522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44119ce1-6f3d-4ea3-b944-7a406da6c28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44119ce1-6f3d-4ea3-b944-7a406da6c28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d852e8-5c55-4b42-9d11-ce7d3c0e2fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d852e8-5c55-4b42-9d11-ce7d3c0e2fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3946995-df9f-42c4-ae9c-0b88ac23b69d', 'volume_name': 'volume-c3946995-df9f-42c4-ae9c-0b88ac23b69d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1b07fb-0bb5-4b20-be1d-b87e32232aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1b07fb-0bb5-4b20-be1d-b87e32232aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08b5dada-df5d-4b14-9f6d-5769990d0f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:12 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Volume c3946995-df9f-42c4-ae9c-0b88ac23b69d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3946995-df9f-42c4-ae9c-0b88ac23b69d', 'volume_size': 1}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:12 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d8a3f0df-8b30-45d2-b76f-194d4d57552f" returned: 0 in 0.337s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.986s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1178717496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ed5822-cf1f-4925-81e0-bf183c48df80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962e4e5cd68c455a965f7e07e9a854e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:09Z,use_quota=True,user_id='4cf7b69fb0444b9d868c64c44ede0c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Creating volume 22ed5822-cf1f-4925-81e0-bf183c48df80 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:23:12 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-22ed5822-cf1f-4925-81e0-bf183c48df80 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08dddbb9-62db-4cf0-a3a8-5be9f85594ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8a3f0df-8b30-45d2-b76f-194d4d57552f', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cdc9106-dad2-4219-9813-303970424a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:12 devstack sudo[107011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-22ed5822-cf1f-4925-81e0-bf183c48df80 1073741824
Nov 05 15:23:12 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:12 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Volume volume-d8a3f0df-8b30-45d2-b76f-194d4d57552f (d8a3f0df-8b30-45d2-b76f-194d4d57552f): created successfully
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cdc9106-dad2-4219-9813-303970424a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Flow 'volume_create_manager' (c8033cb4-c6eb-4848-a19c-cf8dc0a29cc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:12 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5f35bae2-aa7c-4764-be86-d146e72095f4 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Created volume successfully.
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Flow 'volume_create_manager' (1c4ccf17-73b2-40be-95f2-ee0d7f2bca78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6019df-d81f-4127-a297-e1e87e21b33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6019df-d81f-4127-a297-e1e87e21b33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-442647232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe582ba-eff6-44e8-a192-df0e0faecb35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df1caec296c4850896ffa28c7b7d2b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:13Z,use_quota=True,user_id='545c323e4c124ff1b081df240c8a6522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a272e3b-3282-4d29-9fa6-a035dd0bec35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a272e3b-3282-4d29-9fa6-a035dd0bec35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f165d9-e4d0-4ae1-b8a9-b076a3b4bd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f165d9-e4d0-4ae1-b8a9-b076a3b4bd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abe582ba-eff6-44e8-a192-df0e0faecb35', 'volume_name': 'volume-abe582ba-eff6-44e8-a192-df0e0faecb35', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6f66f9-40b3-40b9-96fb-fb0480b6401a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6f66f9-40b3-40b9-96fb-fb0480b6401a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eaaf80d-24e5-4a07-9133-f3b6e1316b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:12 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Volume abe582ba-eff6-44e8-a192-df0e0faecb35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abe582ba-eff6-44e8-a192-df0e0faecb35', 'volume_size': 1}
Nov 05 15:23:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:13 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-22ed5822-cf1f-4925-81e0-bf183c48df80 1073741824" returned: 0 in 0.590s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Flow 'volume_create_manager' (f4d0d929-7795-4f96-8a8f-9f28362afdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b195e5a1-4b46-48a5-b1a2-82a3e966c6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b195e5a1-4b46-48a5-b1a2-82a3e966c6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1067714248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c06900a-81fb-44b2-ae63-66e6e7b622b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df1caec296c4850896ffa28c7b7d2b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:13Z,use_quota=True,user_id='545c323e4c124ff1b081df240c8a6522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d3aacf-63b1-4d9a-82d2-e14bed49040a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d3aacf-63b1-4d9a-82d2-e14bed49040a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52617a0a-ead0-4f1d-8384-c38b3380aae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52617a0a-ead0-4f1d-8384-c38b3380aae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c06900a-81fb-44b2-ae63-66e6e7b622b3', 'volume_name': 'volume-2c06900a-81fb-44b2-ae63-66e6e7b622b3', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4367f5-1d0e-4875-a1f5-3cf237bdd222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4367f5-1d0e-4875-a1f5-3cf237bdd222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543387b0-f4b5-42fb-9767-145fc8bf7cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:13 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Volume 2c06900a-81fb-44b2-ae63-66e6e7b622b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c06900a-81fb-44b2-ae63-66e6e7b622b3', 'volume_size': 1}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-22ed5822-cf1f-4925-81e0-bf183c48df80 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:13 devstack sudo[107017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-22ed5822-cf1f-4925-81e0-bf183c48df80
Nov 05 15:23:13 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:13 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-22ed5822-cf1f-4925-81e0-bf183c48df80" returned: 0 in 0.250s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.482s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-345522893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10fbccf5-a96b-49ab-b73a-7c3df0d73dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962e4e5cd68c455a965f7e07e9a854e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:10Z,use_quota=True,user_id='4cf7b69fb0444b9d868c64c44ede0c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Creating volume 10fbccf5-a96b-49ab-b73a-7c3df0d73dd1 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:23:13 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-10fbccf5-a96b-49ab-b73a-7c3df0d73dd1 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3545d746-ea52-45d0-84a9-5cbedb472990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22ed5822-cf1f-4925-81e0-bf183c48df80', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:13 devstack sudo[107020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-10fbccf5-a96b-49ab-b73a-7c3df0d73dd1 1073741824
Nov 05 15:23:13 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9437751d-838d-4b07-9fff-710f50e3f159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:13 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Volume volume-22ed5822-cf1f-4925-81e0-bf183c48df80 (22ed5822-cf1f-4925-81e0-bf183c48df80): created successfully
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9437751d-838d-4b07-9fff-710f50e3f159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Flow 'volume_create_manager' (2d5b4f13-8be3-4ea7-9356-4f964b305043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:13 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-82b2cb37-69bb-40b3-9524-28c236967172 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Created volume successfully.
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Flow 'volume_create_manager' (4141102a-1e97-4623-af91-376095bd2ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eff4e37-89d6-4c51-a1a8-7e249419024d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eff4e37-89d6-4c51-a1a8-7e249419024d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edace9d7-c2fb-419c-8ded-ff99ab9b606d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20df29688eb848caa8e3a6269feba880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:14Z,use_quota=True,user_id='46620013551644ef80a5397d18604037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8541440-a823-4b76-84a6-c2f717b2911f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8541440-a823-4b76-84a6-c2f717b2911f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a724580-1488-49f2-b1f6-ee7d86407ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:13 devstack cinder-volume[87150]: DEBUG cinder.image.glance [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Creating Keystone auth plugin from conf {{(pid=87150) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 15:23:14 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-10fbccf5-a96b-49ab-b73a-7c3df0d73dd1 1073741824" returned: 0 in 0.530s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-10fbccf5-a96b-49ab-b73a-7c3df0d73dd1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:14 devstack sudo[107026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-10fbccf5-a96b-49ab-b73a-7c3df0d73dd1
Nov 05 15:23:14 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a724580-1488-49f2-b1f6-ee7d86407ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'edace9d7-c2fb-419c-8ded-ff99ab9b606d', 'volume_name': 'volume-edace9d7-c2fb-419c-8ded-ff99ab9b606d', 'volume_size': 1, 'image_id': '91212a1e-bea3-436c-9557-cbccf631549b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/91212a1e-bea3-436c-9557-cbccf631549b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd81d81bacfb48dc91689f1fcd6b3b14a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '20df29688eb848caa8e3a6269feba880', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf8d3caafcb307ac9de41ae2ec00026433495ed637e94866ce0f7643956992eadb9310b38a9c49c1dc8aa6e9417fbf95bfdef94c552fa4c57720b5c1ba934e9f', 'id': '91212a1e-bea3-436c-9557-cbccf631549b', 'created_at': datetime.datetime(2026, 11, 5, 14, 23, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 23, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/91212a1e-bea3-436c-9557-cbccf631549b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfacea20200>}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b1fe781-9e5c-4019-92d1-7069eaaaa05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b1fe781-9e5c-4019-92d1-7069eaaaa05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (150fe89d-4cf8-4ad2-8199-247df60f4d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:14 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Volume edace9d7-c2fb-419c-8ded-ff99ab9b606d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-edace9d7-c2fb-419c-8ded-ff99ab9b606d', 'volume_size': 1, 'image_id': '91212a1e-bea3-436c-9557-cbccf631549b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/91212a1e-bea3-436c-9557-cbccf631549b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd81d81bacfb48dc91689f1fcd6b3b14a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '20df29688eb848caa8e3a6269feba880', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf8d3caafcb307ac9de41ae2ec00026433495ed637e94866ce0f7643956992eadb9310b38a9c49c1dc8aa6e9417fbf95bfdef94c552fa4c57720b5c1ba934e9f', 'id': '91212a1e-bea3-436c-9557-cbccf631549b', 'created_at': datetime.datetime(2026, 11, 5, 14, 23, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 23, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/91212a1e-bea3-436c-9557-cbccf631549b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfacea20200>}
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Trying to clone edace9d7-c2fb-419c-8ded-ff99ab9b606d from image 91212a1e-bea3-436c-9557-cbccf631549b at location (None, [{'url': 'file:///opt/stack/data/glance/images/91212a1e-bea3-436c-9557-cbccf631549b', 'metadata': {}}]). {{(pid=87150) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 15:23:14 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b202e4ba-dcf4-405f-910d-863194b7e1b1]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:14 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-10fbccf5-a96b-49ab-b73a-7c3df0d73dd1" returned: 0 in 0.247s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.937s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1876011860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74fa2174-9848-4344-99fa-588149b48cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962e4e5cd68c455a965f7e07e9a854e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:10Z,use_quota=True,user_id='4cf7b69fb0444b9d868c64c44ede0c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Creating volume 74fa2174-9848-4344-99fa-588149b48cb9 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:23:14 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-74fa2174-9848-4344-99fa-588149b48cb9 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748967d3-46f1-4e6e-8dac-d3b56f581066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10fbccf5-a96b-49ab-b73a-7c3df0d73dd1', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:14 devstack sudo[107030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-74fa2174-9848-4344-99fa-588149b48cb9 1073741824
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a166589-8c86-46f1-a31f-7af9f9c009a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:14 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:14 devstack sudo[107028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD
Nov 05 15:23:14 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:14 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Volume volume-10fbccf5-a96b-49ab-b73a-7c3df0d73dd1 (10fbccf5-a96b-49ab-b73a-7c3df0d73dd1): created successfully
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a166589-8c86-46f1-a31f-7af9f9c009a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Flow 'volume_create_manager' (99f87c6c-9cd5-44c9-af15-91ee29d2fb88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:14 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-05794a2e-f7e7-4dff-a903-022fa844dfc6 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Created volume successfully.
Nov 05 15:23:14 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:14 devstack sudo[107037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD
Nov 05 15:23:14 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:14 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-74fa2174-9848-4344-99fa-588149b48cb9 1073741824" returned: 0 in 0.517s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-74fa2174-9848-4344-99fa-588149b48cb9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:14 devstack sudo[107041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-74fa2174-9848-4344-99fa-588149b48cb9
Nov 05 15:23:14 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:14 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 15:23:14 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Temporary image 91212a1e-bea3-436c-9557-cbccf631549b is fetched for user 46620013551644ef80a5397d18604037. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafd499e-c6ad-4511-aa17-d9b0a430028f]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:15 devstack sudo[107047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD
Nov 05 15:23:15 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:15 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-74fa2174-9848-4344-99fa-588149b48cb9" returned: 0 in 0.266s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.831s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-976459245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8751b2-abbe-49ca-bd4e-b02d037d06c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df1caec296c4850896ffa28c7b7d2b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:11Z,use_quota=True,user_id='545c323e4c124ff1b081df240c8a6522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Creating volume 7f8751b2-abbe-49ca-bd4e-b02d037d06c0 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:23:15 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7f8751b2-abbe-49ca-bd4e-b02d037d06c0 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88abf709-6a04-4753-9bb2-497c2758751c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74fa2174-9848-4344-99fa-588149b48cb9', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:15 devstack sudo[107050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7f8751b2-abbe-49ca-bd4e-b02d037d06c0 1073741824
Nov 05 15:23:15 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6dd3999-ea47-4390-8f2b-051687b8d0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:15 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Volume volume-74fa2174-9848-4344-99fa-588149b48cb9 (74fa2174-9848-4344-99fa-588149b48cb9): created successfully
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6dd3999-ea47-4390-8f2b-051687b8d0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Flow 'volume_create_manager' (d1886bf1-ba0e-4a52-a347-0837b6b9736b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:15 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-92d42ab2-9141-47d3-a5bb-c4243c0f9129 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Created volume successfully.
Nov 05 15:23:15 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:15 devstack sudo[107054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD
Nov 05 15:23:15 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:15 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7f8751b2-abbe-49ca-bd4e-b02d037d06c0 1073741824" returned: 0 in 0.412s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7f8751b2-abbe-49ca-bd4e-b02d037d06c0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:15 devstack sudo[107060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7f8751b2-abbe-49ca-bd4e-b02d037d06c0
Nov 05 15:23:15 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:15 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:15 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7f8751b2-abbe-49ca-bd4e-b02d037d06c0" returned: 0 in 0.262s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.020s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-911832791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=642e2e22-ad3e-4317-9d10-a49f23436716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9e03f4a164bf48042da27edfd742d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:12Z,use_quota=True,user_id='d3585054b64542a1a174061b1731d371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Creating volume 642e2e22-ad3e-4317-9d10-a49f23436716 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:23:15 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c368dede-4a5d-4601-b959-212dc810f59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f8751b2-abbe-49ca-bd4e-b02d037d06c0', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:15 devstack sudo[107066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716 1073741824
Nov 05 15:23:15 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c19678e-6fe6-41ba-9da5-cb095e283f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:15 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Volume volume-7f8751b2-abbe-49ca-bd4e-b02d037d06c0 (7f8751b2-abbe-49ca-bd4e-b02d037d06c0): created successfully
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c19678e-6fe6-41ba-9da5-cb095e283f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Flow 'volume_create_manager' (fa1db610-12b6-44de-856d-dd6c4eb392cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:16 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7bfe6a35-7cab-44d9-815e-b8c0a5062c8a tempest-CreateVolumesFromSnapshotTest-501279056 None] Created volume successfully.
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-83deda87-1afb-4cf3-a39e-02843a535d0e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "cinder-74fa2174-9848-4344-99fa-588149b48cb9-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-83deda87-1afb-4cf3-a39e-02843a535d0e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "cinder-74fa2174-9848-4344-99fa-588149b48cb9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-83deda87-1afb-4cf3-a39e-02843a535d0e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "cinder-quobyte-74fa2174-9848-4344-99fa-588149b48cb9" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-83deda87-1afb-4cf3-a39e-02843a535d0e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "cinder-quobyte-74fa2174-9848-4344-99fa-588149b48cb9" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e50e9f-e584-492b-bc1d-8c66b043e83c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-83deda87-1afb-4cf3-a39e-02843a535d0e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-74fa2174-9848-4344-99fa-588149b48cb9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:16 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716 1073741824" returned: 0 in 0.486s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:16 devstack sudo[107072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-74fa2174-9848-4344-99fa-588149b48cb9
Nov 05 15:23:16 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:16 devstack sudo[107074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716
Nov 05 15:23:16 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:16 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:16 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716" returned: 0 in 0.251s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.569s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-380485472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb01e94-abd5-43df-a4fc-d31149610267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df1caec296c4850896ffa28c7b7d2b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:12Z,use_quota=True,user_id='545c323e4c124ff1b081df240c8a6522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Creating volume fcb01e94-abd5-43df-a4fc-d31149610267 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:23:16 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fcb01e94-abd5-43df-a4fc-d31149610267 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-83deda87-1afb-4cf3-a39e-02843a535d0e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-74fa2174-9848-4344-99fa-588149b48cb9" returned: 0 in 0.409s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-83deda87-1afb-4cf3-a39e-02843a535d0e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-74fa2174-9848-4344-99fa-588149b48cb9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:16 devstack sudo[107080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fcb01e94-abd5-43df-a4fc-d31149610267 1073741824
Nov 05 15:23:16 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf3296ce-fa87-4867-a52a-7dc96cde6655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-642e2e22-ad3e-4317-9d10-a49f23436716', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ebb5349-3839-4b28-8a41-ce43364e8ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:16 devstack sudo[107081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-74fa2174-9848-4344-99fa-588149b48cb9
Nov 05 15:23:16 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:16 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Volume volume-642e2e22-ad3e-4317-9d10-a49f23436716 (642e2e22-ad3e-4317-9d10-a49f23436716): created successfully
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ebb5349-3839-4b28-8a41-ce43364e8ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Flow 'volume_create_manager' (4eaea9b9-dbf5-46d6-9dc5-8a851fafa582) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:16 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-946e3e96-8f98-4309-9996-2b840cd853f6 tempest-ProjectMemberTests-340429542 None] Created volume successfully.
Nov 05 15:23:17 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-83deda87-1afb-4cf3-a39e-02843a535d0e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-74fa2174-9848-4344-99fa-588149b48cb9" returned: 0 in 0.271s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-83deda87-1afb-4cf3-a39e-02843a535d0e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "cinder-quobyte-74fa2174-9848-4344-99fa-588149b48cb9" released by "delete_volume" :: held 0.731s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-83deda87-1afb-4cf3-a39e-02843a535d0e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Created reservations ['2c554815-b0b3-4ca0-8198-a35695f8ced9', 'abee0097-5298-4d4a-9cb0-13469097aee4', '8d31e444-4d42-42af-a0c5-b5b833b133b0', '8d0da99c-4ab8-4517-b20f-a4df76bf643f'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-83deda87-1afb-4cf3-a39e-02843a535d0e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-83deda87-1afb-4cf3-a39e-02843a535d0e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-83deda87-1afb-4cf3-a39e-02843a535d0e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-83deda87-1afb-4cf3-a39e-02843a535d0e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-83deda87-1afb-4cf3-a39e-02843a535d0e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-83deda87-1afb-4cf3-a39e-02843a535d0e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:17 devstack sudo[107089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:23:17 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-271d2809-008e-4080-951b-375777e47abc tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:17 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fcb01e94-abd5-43df-a4fc-d31149610267 1073741824" returned: 0 in 0.545s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fcb01e94-abd5-43df-a4fc-d31149610267 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:17 devstack sudo[107091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fcb01e94-abd5-43df-a4fc-d31149610267
Nov 05 15:23:17 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-66aa0f57-147f-4179-8fbf-d99e349078c0 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "cinder-10fbccf5-a96b-49ab-b73a-7c3df0d73dd1-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:17 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-66aa0f57-147f-4179-8fbf-d99e349078c0 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "cinder-10fbccf5-a96b-49ab-b73a-7c3df0d73dd1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-83deda87-1afb-4cf3-a39e-02843a535d0e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.283s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-83deda87-1afb-4cf3-a39e-02843a535d0e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:23:17 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-83deda87-1afb-4cf3-a39e-02843a535d0e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Deleted volume successfully.
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-83deda87-1afb-4cf3-a39e-02843a535d0e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "cinder-74fa2174-9848-4344-99fa-588149b48cb9-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-66aa0f57-147f-4179-8fbf-d99e349078c0 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "cinder-quobyte-10fbccf5-a96b-49ab-b73a-7c3df0d73dd1" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-66aa0f57-147f-4179-8fbf-d99e349078c0 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "cinder-quobyte-10fbccf5-a96b-49ab-b73a-7c3df0d73dd1" acquired by "delete_volume" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fd3212-4265-4ca0-a22e-ed354edd6c12]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-66aa0f57-147f-4179-8fbf-d99e349078c0 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-10fbccf5-a96b-49ab-b73a-7c3df0d73dd1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:17 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fcb01e94-abd5-43df-a4fc-d31149610267" returned: 0 in 0.292s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.170s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-866077799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3946995-df9f-42c4-ae9c-0b88ac23b69d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df1caec296c4850896ffa28c7b7d2b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:12Z,use_quota=True,user_id='545c323e4c124ff1b081df240c8a6522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Creating volume c3946995-df9f-42c4-ae9c-0b88ac23b69d {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:23:17 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c3946995-df9f-42c4-ae9c-0b88ac23b69d 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e3a0d8-2ec3-4fbe-88d8-50e457fe04c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcb01e94-abd5-43df-a4fc-d31149610267', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:17 devstack sudo[107096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c3946995-df9f-42c4-ae9c-0b88ac23b69d 1073741824
Nov 05 15:23:17 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef14d75-5dca-4d4d-9fd5-75cd50d54fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:17 devstack sudo[107094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-10fbccf5-a96b-49ab-b73a-7c3df0d73dd1
Nov 05 15:23:17 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:17 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Volume volume-fcb01e94-abd5-43df-a4fc-d31149610267 (fcb01e94-abd5-43df-a4fc-d31149610267): created successfully
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef14d75-5dca-4d4d-9fd5-75cd50d54fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Flow 'volume_create_manager' (5ca7047a-f746-411e-bd47-1a0010722732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:17 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-abdd9642-a93e-437c-8abf-c618fce42c24 tempest-CreateVolumesFromSnapshotTest-501279056 None] Created volume successfully.
Nov 05 15:23:17 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-66aa0f57-147f-4179-8fbf-d99e349078c0 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-10fbccf5-a96b-49ab-b73a-7c3df0d73dd1" returned: 0 in 0.445s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-66aa0f57-147f-4179-8fbf-d99e349078c0 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-10fbccf5-a96b-49ab-b73a-7c3df0d73dd1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:18 devstack sudo[107109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-10fbccf5-a96b-49ab-b73a-7c3df0d73dd1
Nov 05 15:23:18 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:18 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c3946995-df9f-42c4-ae9c-0b88ac23b69d 1073741824" returned: 0 in 0.489s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c3946995-df9f-42c4-ae9c-0b88ac23b69d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:18 devstack sudo[107111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c3946995-df9f-42c4-ae9c-0b88ac23b69d
Nov 05 15:23:18 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:18 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-66aa0f57-147f-4179-8fbf-d99e349078c0 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-10fbccf5-a96b-49ab-b73a-7c3df0d73dd1" returned: 0 in 0.268s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-66aa0f57-147f-4179-8fbf-d99e349078c0 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "cinder-quobyte-10fbccf5-a96b-49ab-b73a-7c3df0d73dd1" released by "delete_volume" :: held 0.757s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-66aa0f57-147f-4179-8fbf-d99e349078c0 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Created reservations ['fcb12162-8881-40da-8dc9-08319e6bec97', 'd49fcd03-169e-4ea4-a341-99d0fd05635f', '52498d20-425b-49da-9a91-983cd15f4bfc', 'f7597f3c-830a-42c4-a679-82a55f04a993'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-66aa0f57-147f-4179-8fbf-d99e349078c0 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-66aa0f57-147f-4179-8fbf-d99e349078c0 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-66aa0f57-147f-4179-8fbf-d99e349078c0 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-66aa0f57-147f-4179-8fbf-d99e349078c0 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-66aa0f57-147f-4179-8fbf-d99e349078c0 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-66aa0f57-147f-4179-8fbf-d99e349078c0 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:18 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c3946995-df9f-42c4-ae9c-0b88ac23b69d" returned: 0 in 0.269s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.517s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-442647232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe582ba-eff6-44e8-a192-df0e0faecb35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df1caec296c4850896ffa28c7b7d2b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:13Z,use_quota=True,user_id='545c323e4c124ff1b081df240c8a6522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Creating volume abe582ba-eff6-44e8-a192-df0e0faecb35 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:23:18 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-abe582ba-eff6-44e8-a192-df0e0faecb35 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:18 devstack sudo[107115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:23:18 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08b5dada-df5d-4b14-9f6d-5769990d0f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3946995-df9f-42c4-ae9c-0b88ac23b69d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:18 devstack sudo[107117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-abe582ba-eff6-44e8-a192-df0e0faecb35 1073741824
Nov 05 15:23:18 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f2b0a14-7a48-4907-8164-3112b3449b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:18 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Volume volume-c3946995-df9f-42c4-ae9c-0b88ac23b69d (c3946995-df9f-42c4-ae9c-0b88ac23b69d): created successfully
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f2b0a14-7a48-4907-8164-3112b3449b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Flow 'volume_create_manager' (e7231abd-dfd1-43d9-bb8a-4d161a815355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6a5eef1d-bb28-4f13-a884-54269380847b tempest-CreateVolumesFromSnapshotTest-501279056 None] Created volume successfully.
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bb9f4aa9-a258-4ff7-b821-e523eaa1d70b tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "cinder-22ed5822-cf1f-4925-81e0-bf183c48df80-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bb9f4aa9-a258-4ff7-b821-e523eaa1d70b tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "cinder-22ed5822-cf1f-4925-81e0-bf183c48df80-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bb9f4aa9-a258-4ff7-b821-e523eaa1d70b tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "cinder-quobyte-22ed5822-cf1f-4925-81e0-bf183c48df80" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bb9f4aa9-a258-4ff7-b821-e523eaa1d70b tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "cinder-quobyte-22ed5822-cf1f-4925-81e0-bf183c48df80" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:18 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-66aa0f57-147f-4179-8fbf-d99e349078c0 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.338s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-66aa0f57-147f-4179-8fbf-d99e349078c0 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:23:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-66aa0f57-147f-4179-8fbf-d99e349078c0 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Deleted volume successfully.
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5603a3dd-e8d7-45c1-aa42-c8c2fe22d128]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bb9f4aa9-a258-4ff7-b821-e523eaa1d70b tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-22ed5822-cf1f-4925-81e0-bf183c48df80 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-66aa0f57-147f-4179-8fbf-d99e349078c0 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "cinder-10fbccf5-a96b-49ab-b73a-7c3df0d73dd1-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:18 devstack sudo[107123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-22ed5822-cf1f-4925-81e0-bf183c48df80
Nov 05 15:23:18 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:18 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-abe582ba-eff6-44e8-a192-df0e0faecb35 1073741824" returned: 0 in 0.529s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-abe582ba-eff6-44e8-a192-df0e0faecb35 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:19 devstack sudo[107126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-abe582ba-eff6-44e8-a192-df0e0faecb35
Nov 05 15:23:19 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:19 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bb9f4aa9-a258-4ff7-b821-e523eaa1d70b tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-22ed5822-cf1f-4925-81e0-bf183c48df80" returned: 0 in 0.378s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bb9f4aa9-a258-4ff7-b821-e523eaa1d70b tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-22ed5822-cf1f-4925-81e0-bf183c48df80 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:19 devstack sudo[107131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-22ed5822-cf1f-4925-81e0-bf183c48df80
Nov 05 15:23:19 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:19 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-abe582ba-eff6-44e8-a192-df0e0faecb35" returned: 0 in 0.263s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.989s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1067714248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c06900a-81fb-44b2-ae63-66e6e7b622b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df1caec296c4850896ffa28c7b7d2b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:13Z,use_quota=True,user_id='545c323e4c124ff1b081df240c8a6522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Creating volume 2c06900a-81fb-44b2-ae63-66e6e7b622b3 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:23:19 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2c06900a-81fb-44b2-ae63-66e6e7b622b3 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eaaf80d-24e5-4a07-9133-f3b6e1316b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abe582ba-eff6-44e8-a192-df0e0faecb35', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e08d480-29ee-4822-bd2f-af5711f30669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:19 devstack sudo[107134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2c06900a-81fb-44b2-ae63-66e6e7b622b3 1073741824
Nov 05 15:23:19 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:19 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Volume volume-abe582ba-eff6-44e8-a192-df0e0faecb35 (abe582ba-eff6-44e8-a192-df0e0faecb35): created successfully
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e08d480-29ee-4822-bd2f-af5711f30669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Flow 'volume_create_manager' (1c4ccf17-73b2-40be-95f2-ee0d7f2bca78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:19 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c889badf-0805-49d2-92d2-539efcfdccc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Created volume successfully.
Nov 05 15:23:19 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bb9f4aa9-a258-4ff7-b821-e523eaa1d70b tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-22ed5822-cf1f-4925-81e0-bf183c48df80" returned: 0 in 0.258s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bb9f4aa9-a258-4ff7-b821-e523eaa1d70b tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "cinder-quobyte-22ed5822-cf1f-4925-81e0-bf183c48df80" released by "delete_volume" :: held 0.689s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-bb9f4aa9-a258-4ff7-b821-e523eaa1d70b tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Created reservations ['f8743931-d159-4270-bceb-724119d630cd', '99f8e8ed-3bfd-4fcd-9fcc-8cbb2ab4d8fe', '6e0702b6-0be7-4df7-a1df-2c3f7a23049d', '932deed5-dde0-4097-82fe-635294012252'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bb9f4aa9-a258-4ff7-b821-e523eaa1d70b tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bb9f4aa9-a258-4ff7-b821-e523eaa1d70b tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bb9f4aa9-a258-4ff7-b821-e523eaa1d70b tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bb9f4aa9-a258-4ff7-b821-e523eaa1d70b tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bb9f4aa9-a258-4ff7-b821-e523eaa1d70b tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bb9f4aa9-a258-4ff7-b821-e523eaa1d70b tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:19 devstack sudo[107140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:23:19 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:19 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2c06900a-81fb-44b2-ae63-66e6e7b622b3 1073741824" returned: 0 in 0.495s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:19 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bb9f4aa9-a258-4ff7-b821-e523eaa1d70b tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.281s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-bb9f4aa9-a258-4ff7-b821-e523eaa1d70b tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6c0eb143-2ac9-4b00-aa40-00ba68a14f5e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "cinder-d8a3f0df-8b30-45d2-b76f-194d4d57552f-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:19 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-bb9f4aa9-a258-4ff7-b821-e523eaa1d70b tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Deleted volume successfully.
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2c06900a-81fb-44b2-ae63-66e6e7b622b3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6c0eb143-2ac9-4b00-aa40-00ba68a14f5e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "cinder-d8a3f0df-8b30-45d2-b76f-194d4d57552f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bb9f4aa9-a258-4ff7-b821-e523eaa1d70b tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "cinder-22ed5822-cf1f-4925-81e0-bf183c48df80-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:19 devstack sudo[107145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2c06900a-81fb-44b2-ae63-66e6e7b622b3
Nov 05 15:23:19 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6c0eb143-2ac9-4b00-aa40-00ba68a14f5e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "cinder-quobyte-d8a3f0df-8b30-45d2-b76f-194d4d57552f" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6c0eb143-2ac9-4b00-aa40-00ba68a14f5e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "cinder-quobyte-d8a3f0df-8b30-45d2-b76f-194d4d57552f" acquired by "delete_volume" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c604db-afe4-423c-a9b7-82ef9a725b6a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6c0eb143-2ac9-4b00-aa40-00ba68a14f5e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d8a3f0df-8b30-45d2-b76f-194d4d57552f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:20 devstack sudo[107147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d8a3f0df-8b30-45d2-b76f-194d4d57552f
Nov 05 15:23:20 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:20 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2c06900a-81fb-44b2-ae63-66e6e7b622b3" returned: 0 in 0.276s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.350s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edace9d7-c2fb-419c-8ded-ff99ab9b606d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20df29688eb848caa8e3a6269feba880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:14Z,use_quota=True,user_id='46620013551644ef80a5397d18604037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Creating volume edace9d7-c2fb-419c-8ded-ff99ab9b606d {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:23:20 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-edace9d7-c2fb-419c-8ded-ff99ab9b606d 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543387b0-f4b5-42fb-9767-145fc8bf7cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c06900a-81fb-44b2-ae63-66e6e7b622b3', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd774b3-7b43-472e-b9fc-d16e4ac67740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:20 devstack sudo[107150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-edace9d7-c2fb-419c-8ded-ff99ab9b606d 1073741824
Nov 05 15:23:20 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:20 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Volume volume-2c06900a-81fb-44b2-ae63-66e6e7b622b3 (2c06900a-81fb-44b2-ae63-66e6e7b622b3): created successfully
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd774b3-7b43-472e-b9fc-d16e4ac67740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Flow 'volume_create_manager' (f4d0d929-7795-4f96-8a8f-9f28362afdbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:20 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3896cfd3-adeb-4ac5-9a70-b18083e0d45e tempest-CreateVolumesFromSnapshotTest-501279056 None] Created volume successfully.
Nov 05 15:23:20 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6c0eb143-2ac9-4b00-aa40-00ba68a14f5e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d8a3f0df-8b30-45d2-b76f-194d4d57552f" returned: 0 in 0.378s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6c0eb143-2ac9-4b00-aa40-00ba68a14f5e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d8a3f0df-8b30-45d2-b76f-194d4d57552f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:20 devstack sudo[107157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d8a3f0df-8b30-45d2-b76f-194d4d57552f
Nov 05 15:23:20 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:20 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-edace9d7-c2fb-419c-8ded-ff99ab9b606d 1073741824" returned: 0 in 0.436s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-edace9d7-c2fb-419c-8ded-ff99ab9b606d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:20 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:20 devstack sudo[107162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-edace9d7-c2fb-419c-8ded-ff99ab9b606d
Nov 05 15:23:20 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6c0eb143-2ac9-4b00-aa40-00ba68a14f5e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d8a3f0df-8b30-45d2-b76f-194d4d57552f" returned: 0 in 0.293s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6c0eb143-2ac9-4b00-aa40-00ba68a14f5e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "cinder-quobyte-d8a3f0df-8b30-45d2-b76f-194d4d57552f" released by "delete_volume" :: held 0.719s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-6c0eb143-2ac9-4b00-aa40-00ba68a14f5e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Created reservations ['e86c29ee-dc3e-42e1-8ad7-1d48801b32a6', '941ccd65-6ccd-4788-906a-684f2d27232b', 'ac07ac6d-33fb-44e5-bc14-9c4a9215a7e8', '775ac470-63f8-4277-a242-6d93daff9c95'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6c0eb143-2ac9-4b00-aa40-00ba68a14f5e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6c0eb143-2ac9-4b00-aa40-00ba68a14f5e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6c0eb143-2ac9-4b00-aa40-00ba68a14f5e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6c0eb143-2ac9-4b00-aa40-00ba68a14f5e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6c0eb143-2ac9-4b00-aa40-00ba68a14f5e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6c0eb143-2ac9-4b00-aa40-00ba68a14f5e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:20 devstack sudo[107164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:23:20 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:20 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-edace9d7-c2fb-419c-8ded-ff99ab9b606d" returned: 0 in 0.265s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-271d2809-008e-4080-951b-375777e47abc tempest-ProjectMemberTests-340429542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.636s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-271d2809-008e-4080-951b-375777e47abc tempest-ProjectMemberTests-340429542 None] Creating offline snapshot bd98b81a-a1e9-4b34-bca4-c2d1e504c037 of volume 642e2e22-ad3e-4317-9d10-a49f23436716 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9932caca-e67c-4788-b58f-3ed790495a8b tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "cinder-2c06900a-81fb-44b2-ae63-66e6e7b622b3-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Attempting download of 91212a1e-bea3-436c-9557-cbccf631549b ((None, [{'url': 'file:///opt/stack/data/glance/images/91212a1e-bea3-436c-9557-cbccf631549b', 'metadata': {}}])) to volume edace9d7-c2fb-419c-8ded-ff99ab9b606d. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d40e8a-a1b9-4b2f-a488-d7853ec5f02e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-271d2809-008e-4080-951b-375777e47abc tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9932caca-e67c-4788-b58f-3ed790495a8b tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-2c06900a-81fb-44b2-ae63-66e6e7b622b3-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5aee7734-3483-425a-a2f8-6c8c85aa061f tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "cinder-b5917964-3c9e-41cc-a3a3-b10717c432ac-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[98529ff8-96ea-4614-bd23-f54a5aafc006]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_91212a1e-bea3-436c-9557-cbccf631549b_hnybhgb8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9932caca-e67c-4788-b58f-3ed790495a8b tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "cinder-quobyte-2c06900a-81fb-44b2-ae63-66e6e7b622b3" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9932caca-e67c-4788-b58f-3ed790495a8b tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-quobyte-2c06900a-81fb-44b2-ae63-66e6e7b622b3" acquired by "delete_volume" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:21 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5aee7734-3483-425a-a2f8-6c8c85aa061f tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "cinder-b5917964-3c9e-41cc-a3a3-b10717c432ac-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6c0eb143-2ac9-4b00-aa40-00ba68a14f5e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.353s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-6c0eb143-2ac9-4b00-aa40-00ba68a14f5e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:23:21 devstack sudo[107167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716
Nov 05 15:23:21 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:21 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6c0eb143-2ac9-4b00-aa40-00ba68a14f5e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Deleted volume successfully.
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7baf6759-8ca1-49f6-917e-d37a11cc2e7d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9932caca-e67c-4788-b58f-3ed790495a8b tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2c06900a-81fb-44b2-ae63-66e6e7b622b3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5aee7734-3483-425a-a2f8-6c8c85aa061f tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "cinder-quobyte-b5917964-3c9e-41cc-a3a3-b10717c432ac" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:21 devstack sudo[107169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_91212a1e-bea3-436c-9557-cbccf631549b_hnybhgb8
Nov 05 15:23:21 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6c0eb143-2ac9-4b00-aa40-00ba68a14f5e tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "cinder-d8a3f0df-8b30-45d2-b76f-194d4d57552f-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5aee7734-3483-425a-a2f8-6c8c85aa061f tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "cinder-quobyte-b5917964-3c9e-41cc-a3a3-b10717c432ac" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[94eeb4e5-590b-4726-87ed-3608fd30e739]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5aee7734-3483-425a-a2f8-6c8c85aa061f tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b5917964-3c9e-41cc-a3a3-b10717c432ac {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:21 devstack sudo[107174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2c06900a-81fb-44b2-ae63-66e6e7b622b3
Nov 05 15:23:21 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:21 devstack sudo[107179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b5917964-3c9e-41cc-a3a3-b10717c432ac
Nov 05 15:23:21 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:21 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:21 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-271d2809-008e-4080-951b-375777e47abc tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716" returned: 0 in 0.518s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_91212a1e-bea3-436c-9557-cbccf631549b_hnybhgb8" returned: 0 in 0.418s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-271d2809-008e-4080-951b-375777e47abc tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.bd98b81a-a1e9-4b34-bca4-c2d1e504c037 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_91212a1e-bea3-436c-9557-cbccf631549b_hnybhgb8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:21 devstack sudo[107187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.bd98b81a-a1e9-4b34-bca4-c2d1e504c037 1G
Nov 05 15:23:21 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:21 devstack sudo[107188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_91212a1e-bea3-436c-9557-cbccf631549b_hnybhgb8
Nov 05 15:23:21 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:21 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9932caca-e67c-4788-b58f-3ed790495a8b tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2c06900a-81fb-44b2-ae63-66e6e7b622b3" returned: 0 in 0.499s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9932caca-e67c-4788-b58f-3ed790495a8b tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2c06900a-81fb-44b2-ae63-66e6e7b622b3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:21 devstack sudo[107199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2c06900a-81fb-44b2-ae63-66e6e7b622b3
Nov 05 15:23:21 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:21 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5aee7734-3483-425a-a2f8-6c8c85aa061f tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b5917964-3c9e-41cc-a3a3-b10717c432ac" returned: 0 in 0.432s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5aee7734-3483-425a-a2f8-6c8c85aa061f tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b5917964-3c9e-41cc-a3a3-b10717c432ac {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:21 devstack sudo[107203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b5917964-3c9e-41cc-a3a3-b10717c432ac
Nov 05 15:23:21 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:21 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_91212a1e-bea3-436c-9557-cbccf631549b_hnybhgb8" returned: 1 in 0.350s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_91212a1e-bea3-436c-9557-cbccf631549b_hnybhgb8' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d8d93f-03a6-4937-940e-a900834eec58]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:21 devstack sudo[107209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD
Nov 05 15:23:21 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:21 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-271d2809-008e-4080-951b-375777e47abc tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.bd98b81a-a1e9-4b34-bca4-c2d1e504c037 1G" returned: 0 in 0.510s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-271d2809-008e-4080-951b-375777e47abc tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-642e2e22-ad3e-4317-9d10-a49f23436716 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.bd98b81a-a1e9-4b34-bca4-c2d1e504c037 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:21 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9932caca-e67c-4788-b58f-3ed790495a8b tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-2c06900a-81fb-44b2-ae63-66e6e7b622b3" returned: 0 in 0.345s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:21 devstack sudo[107213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-642e2e22-ad3e-4317-9d10-a49f23436716 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.bd98b81a-a1e9-4b34-bca4-c2d1e504c037
Nov 05 15:23:21 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:21 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5aee7734-3483-425a-a2f8-6c8c85aa061f tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b5917964-3c9e-41cc-a3a3-b10717c432ac" returned: 0 in 0.305s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9932caca-e67c-4788-b58f-3ed790495a8b tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-quobyte-2c06900a-81fb-44b2-ae63-66e6e7b622b3" released by "delete_volume" :: held 0.937s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5aee7734-3483-425a-a2f8-6c8c85aa061f tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "cinder-quobyte-b5917964-3c9e-41cc-a3a3-b10717c432ac" released by "delete_volume" :: held 0.805s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-5aee7734-3483-425a-a2f8-6c8c85aa061f tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Created reservations ['b35b4e3c-c971-4861-8d32-41e86c1647e7', '03ad0225-6cc2-4e0f-aee5-ce3ce1f678f5', 'cebc31bb-2bdb-4746-8de7-684c494ec9a1', '598eda1d-3d6a-4cd7-85ef-abd9bacaf3be'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-9932caca-e67c-4788-b58f-3ed790495a8b tempest-CreateVolumesFromSnapshotTest-501279056 None] Created reservations ['a4f9a77a-ad3c-4f31-bd0b-57d36a51f65b', 'a6d34ef2-c441-4d0a-922b-ba0c9b3ea6dc', '4a6adebb-1e72-4266-b471-8912494b5712', '2052c9b4-a201-481d-8a0e-90b228c7cabb'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5aee7734-3483-425a-a2f8-6c8c85aa061f tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5aee7734-3483-425a-a2f8-6c8c85aa061f tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5aee7734-3483-425a-a2f8-6c8c85aa061f tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5aee7734-3483-425a-a2f8-6c8c85aa061f tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5aee7734-3483-425a-a2f8-6c8c85aa061f tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5aee7734-3483-425a-a2f8-6c8c85aa061f tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:22 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:22 devstack sudo[107219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:23:22 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9932caca-e67c-4788-b58f-3ed790495a8b tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9932caca-e67c-4788-b58f-3ed790495a8b tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9932caca-e67c-4788-b58f-3ed790495a8b tempest-CreateVolumesFromSnapshotTest-501279056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9932caca-e67c-4788-b58f-3ed790495a8b tempest-CreateVolumesFromSnapshotTest-501279056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9932caca-e67c-4788-b58f-3ed790495a8b tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9932caca-e67c-4788-b58f-3ed790495a8b tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:22 devstack sudo[107224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:23:22 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:22 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-271d2809-008e-4080-951b-375777e47abc tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-642e2e22-ad3e-4317-9d10-a49f23436716 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.bd98b81a-a1e9-4b34-bca4-c2d1e504c037" returned: 0 in 0.371s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:22 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-271d2809-008e-4080-951b-375777e47abc tempest-ProjectMemberTests-340429542 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.bd98b81a-a1e9-4b34-bca4-c2d1e504c037 is being set with open permissions: ugo+rw
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-271d2809-008e-4080-951b-375777e47abc tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.bd98b81a-a1e9-4b34-bca4-c2d1e504c037 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:22 devstack sudo[107220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD
Nov 05 15:23:22 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:22 devstack sudo[107226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.bd98b81a-a1e9-4b34-bca4-c2d1e504c037
Nov 05 15:23:22 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:22 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5aee7734-3483-425a-a2f8-6c8c85aa061f tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.283s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-5aee7734-3483-425a-a2f8-6c8c85aa061f tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:23:22 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5aee7734-3483-425a-a2f8-6c8c85aa061f tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Deleted volume successfully.
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5aee7734-3483-425a-a2f8-6c8c85aa061f tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "cinder-b5917964-3c9e-41cc-a3a3-b10717c432ac-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:22 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9932caca-e67c-4788-b58f-3ed790495a8b tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.296s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-9932caca-e67c-4788-b58f-3ed790495a8b tempest-CreateVolumesFromSnapshotTest-501279056 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:23:22 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9932caca-e67c-4788-b58f-3ed790495a8b tempest-CreateVolumesFromSnapshotTest-501279056 None] Deleted volume successfully.
Nov 05 15:23:22 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9932caca-e67c-4788-b58f-3ed790495a8b tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-2c06900a-81fb-44b2-ae63-66e6e7b622b3-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD" returned: 1 in 0.384s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] 91212a1e-bea3-436c-9557-cbccf631549b was raw, converting to qcow2 {{(pid=87150) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-edace9d7-c2fb-419c-8ded-ff99ab9b606d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:22 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-271d2809-008e-4080-951b-375777e47abc tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.bd98b81a-a1e9-4b34-bca4-c2d1e504c037" returned: 0 in 0.312s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:22 devstack sudo[107235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-edace9d7-c2fb-419c-8ded-ff99ab9b606d
Nov 05 15:23:22 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-271d2809-008e-4080-951b-375777e47abc tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:22 devstack sudo[107237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.info
Nov 05 15:23:22 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:22 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-271d2809-008e-4080-951b-375777e47abc tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.info" returned: 0 in 0.270s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:22 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-271d2809-008e-4080-951b-375777e47abc tempest-ProjectMemberTests-340429542 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.info is being set with open permissions: ugo+rw
Nov 05 15:23:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-271d2809-008e-4080-951b-375777e47abc tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:22 devstack sudo[107243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.info
Nov 05 15:23:22 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:23 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-edace9d7-c2fb-419c-8ded-ff99ab9b606d" returned: 0 in 0.501s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_91212a1e-bea3-436c-9557-cbccf631549b_9o98nfrxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-edace9d7-c2fb-419c-8ded-ff99ab9b606d {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:23:23 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-edace9d7-c2fb-419c-8ded-ff99ab9b606d 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:23 devstack sudo[107246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-edace9d7-c2fb-419c-8ded-ff99ab9b606d 1G
Nov 05 15:23:23 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7461f645-137d-4c15-aea6-ee08e88c594d tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "cinder-abe582ba-eff6-44e8-a192-df0e0faecb35-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7461f645-137d-4c15-aea6-ee08e88c594d tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-abe582ba-eff6-44e8-a192-df0e0faecb35-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7461f645-137d-4c15-aea6-ee08e88c594d tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "cinder-quobyte-abe582ba-eff6-44e8-a192-df0e0faecb35" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7461f645-137d-4c15-aea6-ee08e88c594d tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-quobyte-abe582ba-eff6-44e8-a192-df0e0faecb35" acquired by "delete_volume" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c66f5532-4914-46ca-b2ae-f2acd50e23a7 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "cinder-0f884c94-c827-485a-acfa-709349910422-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:23 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-271d2809-008e-4080-951b-375777e47abc tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.info" returned: 0 in 0.379s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-271d2809-008e-4080-951b-375777e47abc tempest-ProjectMemberTests-340429542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.499s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a725267e-5a10-43a5-8b9c-5acfdef258fe]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7461f645-137d-4c15-aea6-ee08e88c594d tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-abe582ba-eff6-44e8-a192-df0e0faecb35 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c66f5532-4914-46ca-b2ae-f2acd50e23a7 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "cinder-0f884c94-c827-485a-acfa-709349910422-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:23 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-271d2809-008e-4080-951b-375777e47abc tempest-ProjectMemberTests-340429542 None] Create snapshot completed successfully
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c66f5532-4914-46ca-b2ae-f2acd50e23a7 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "cinder-quobyte-0f884c94-c827-485a-acfa-709349910422" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c66f5532-4914-46ca-b2ae-f2acd50e23a7 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "cinder-quobyte-0f884c94-c827-485a-acfa-709349910422" acquired by "delete_volume" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95d31be-22ca-4245-9658-d9e58e31da7c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c66f5532-4914-46ca-b2ae-f2acd50e23a7 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0f884c94-c827-485a-acfa-709349910422 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:23 devstack sudo[107251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-abe582ba-eff6-44e8-a192-df0e0faecb35
Nov 05 15:23:23 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:23 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-edace9d7-c2fb-419c-8ded-ff99ab9b606d 1G" returned: 0 in 0.407s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Downloaded image 91212a1e-bea3-436c-9557-cbccf631549b ((None, [{'url': 'file:///opt/stack/data/glance/images/91212a1e-bea3-436c-9557-cbccf631549b', 'metadata': {}}])) to volume edace9d7-c2fb-419c-8ded-ff99ab9b606d successfully. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Temporary image 91212a1e-bea3-436c-9557-cbccf631549b for user 46620013551644ef80a5397d18604037 is deleted. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Marking volume edace9d7-c2fb-419c-8ded-ff99ab9b606d as bootable. {{(pid=87150) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Copying metadata from image 91212a1e-bea3-436c-9557-cbccf631549b to edace9d7-c2fb-419c-8ded-ff99ab9b606d. {{(pid=87150) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Creating volume glance metadata for volume edace9d7-c2fb-419c-8ded-ff99ab9b606d backed by image 91212a1e-bea3-436c-9557-cbccf631549b with: {'image_id': '91212a1e-bea3-436c-9557-cbccf631549b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd81d81bacfb48dc91689f1fcd6b3b14a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87150) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (150fe89d-4cf8-4ad2-8199-247df60f4d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edace9d7-c2fb-419c-8ded-ff99ab9b606d', 'volume_size': 1, 'image_id': '91212a1e-bea3-436c-9557-cbccf631549b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/91212a1e-bea3-436c-9557-cbccf631549b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd81d81bacfb48dc91689f1fcd6b3b14a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '20df29688eb848caa8e3a6269feba880', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf8d3caafcb307ac9de41ae2ec00026433495ed637e94866ce0f7643956992eadb9310b38a9c49c1dc8aa6e9417fbf95bfdef94c552fa4c57720b5c1ba934e9f', 'id': '91212a1e-bea3-436c-9557-cbccf631549b', 'created_at': datetime.datetime(2026, 11, 5, 14, 23, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 23, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/91212a1e-bea3-436c-9557-cbccf631549b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bfacea20200>}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716c95fd-9d27-4130-b3a1-a9172307b545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:23 devstack sudo[107255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0f884c94-c827-485a-acfa-709349910422
Nov 05 15:23:23 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:23 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Volume volume-edace9d7-c2fb-419c-8ded-ff99ab9b606d (edace9d7-c2fb-419c-8ded-ff99ab9b606d): created successfully
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716c95fd-9d27-4130-b3a1-a9172307b545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Flow 'volume_create_manager' (4141102a-1e97-4623-af91-376095bd2ac8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:23 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3c2303c5-529d-4649-a542-aac842f0cde1 tempest-VolumeImageDependencyTests-1492885087 None] Created volume successfully.
Nov 05 15:23:23 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7461f645-137d-4c15-aea6-ee08e88c594d tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-abe582ba-eff6-44e8-a192-df0e0faecb35" returned: 0 in 0.404s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7461f645-137d-4c15-aea6-ee08e88c594d tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-abe582ba-eff6-44e8-a192-df0e0faecb35 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:23 devstack sudo[107260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-abe582ba-eff6-44e8-a192-df0e0faecb35
Nov 05 15:23:23 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:23 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c66f5532-4914-46ca-b2ae-f2acd50e23a7 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0f884c94-c827-485a-acfa-709349910422" returned: 0 in 0.401s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c66f5532-4914-46ca-b2ae-f2acd50e23a7 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0f884c94-c827-485a-acfa-709349910422 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:23 devstack sudo[107265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0f884c94-c827-485a-acfa-709349910422
Nov 05 15:23:23 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:24 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7461f645-137d-4c15-aea6-ee08e88c594d tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-abe582ba-eff6-44e8-a192-df0e0faecb35" returned: 0 in 0.253s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7461f645-137d-4c15-aea6-ee08e88c594d tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-quobyte-abe582ba-eff6-44e8-a192-df0e0faecb35" released by "delete_volume" :: held 0.767s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-7461f645-137d-4c15-aea6-ee08e88c594d tempest-CreateVolumesFromSnapshotTest-501279056 None] Created reservations ['33ad94c0-9748-49d1-a785-c2f5040e0a86', '30bf2e69-b6e6-46af-9f38-17e1378ccd5d', '484ae739-49eb-48d1-b4fa-dcfbbdb41d6f', 'cf7b7ecb-86f6-4f8c-8a17-9f8b648e4ce5'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7461f645-137d-4c15-aea6-ee08e88c594d tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7461f645-137d-4c15-aea6-ee08e88c594d tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7461f645-137d-4c15-aea6-ee08e88c594d tempest-CreateVolumesFromSnapshotTest-501279056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7461f645-137d-4c15-aea6-ee08e88c594d tempest-CreateVolumesFromSnapshotTest-501279056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7461f645-137d-4c15-aea6-ee08e88c594d tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7461f645-137d-4c15-aea6-ee08e88c594d tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:24 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c66f5532-4914-46ca-b2ae-f2acd50e23a7 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0f884c94-c827-485a-acfa-709349910422" returned: 0 in 0.276s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:24 devstack sudo[107269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:23:24 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c66f5532-4914-46ca-b2ae-f2acd50e23a7 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "cinder-quobyte-0f884c94-c827-485a-acfa-709349910422" released by "delete_volume" :: held 0.725s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-c66f5532-4914-46ca-b2ae-f2acd50e23a7 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Created reservations ['338a06a1-b068-495a-80a7-f88cd385be49', 'ca454be8-8ebd-4a6b-9cbb-8d8a2768b428', 'c3742917-fc1c-4094-8438-684b36dec320', '818a45cc-302d-4a11-9ae6-c32b2a7cdb70'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c66f5532-4914-46ca-b2ae-f2acd50e23a7 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c66f5532-4914-46ca-b2ae-f2acd50e23a7 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c66f5532-4914-46ca-b2ae-f2acd50e23a7 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c66f5532-4914-46ca-b2ae-f2acd50e23a7 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c66f5532-4914-46ca-b2ae-f2acd50e23a7 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c66f5532-4914-46ca-b2ae-f2acd50e23a7 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:24 devstack sudo[107271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:23:24 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e0dd573b-51ea-452d-a5b5-230b9da2cdc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "cinder-c3946995-df9f-42c4-ae9c-0b88ac23b69d-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e0dd573b-51ea-452d-a5b5-230b9da2cdc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-c3946995-df9f-42c4-ae9c-0b88ac23b69d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:24 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7461f645-137d-4c15-aea6-ee08e88c594d tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.310s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-7461f645-137d-4c15-aea6-ee08e88c594d tempest-CreateVolumesFromSnapshotTest-501279056 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:23:24 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7461f645-137d-4c15-aea6-ee08e88c594d tempest-CreateVolumesFromSnapshotTest-501279056 None] Deleted volume successfully.
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e0dd573b-51ea-452d-a5b5-230b9da2cdc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "cinder-quobyte-c3946995-df9f-42c4-ae9c-0b88ac23b69d" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e0dd573b-51ea-452d-a5b5-230b9da2cdc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-quobyte-c3946995-df9f-42c4-ae9c-0b88ac23b69d" acquired by "delete_volume" :: waited 0.038s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7461f645-137d-4c15-aea6-ee08e88c594d tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-abe582ba-eff6-44e8-a192-df0e0faecb35-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[22004462-d7a7-4611-96c4-51c5c74ee41a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e0dd573b-51ea-452d-a5b5-230b9da2cdc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c3946995-df9f-42c4-ae9c-0b88ac23b69d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d2298bce-745f-48ea-a61a-a412910dcbf7 tempest-VolumeImageDependencyTests-1492885087 None] Acquiring lock "cinder-edace9d7-c2fb-419c-8ded-ff99ab9b606d-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a8f35375-593a-4b31-b9b4-5c56466dd9c4 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-bd98b81a-a1e9-4b34-bca4-c2d1e504c037-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d2298bce-745f-48ea-a61a-a412910dcbf7 tempest-VolumeImageDependencyTests-1492885087 None] Lock "cinder-edace9d7-c2fb-419c-8ded-ff99ab9b606d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a8f35375-593a-4b31-b9b4-5c56466dd9c4 tempest-ProjectMemberTests-340429542 None] Lock "cinder-bd98b81a-a1e9-4b34-bca4-c2d1e504c037-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a8f35375-593a-4b31-b9b4-5c56466dd9c4 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-642e2e22-ad3e-4317-9d10-a49f23436716" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a8f35375-593a-4b31-b9b4-5c56466dd9c4 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-642e2e22-ad3e-4317-9d10-a49f23436716" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a8f35375-593a-4b31-b9b4-5c56466dd9c4 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-bd98b81a-a1e9-4b34-bca4-c2d1e504c037" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d2298bce-745f-48ea-a61a-a412910dcbf7 tempest-VolumeImageDependencyTests-1492885087 None] Acquiring lock "cinder-quobyte-edace9d7-c2fb-419c-8ded-ff99ab9b606d" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a8f35375-593a-4b31-b9b4-5c56466dd9c4 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-bd98b81a-a1e9-4b34-bca4-c2d1e504c037" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a8f35375-593a-4b31-b9b4-5c56466dd9c4 tempest-ProjectMemberTests-340429542 None] Deleting offline snapshot bd98b81a-a1e9-4b34-bca4-c2d1e504c037 of volume 642e2e22-ad3e-4317-9d10-a49f23436716 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:23:24 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a8f35375-593a-4b31-b9b4-5c56466dd9c4 tempest-ProjectMemberTests-340429542 None] snapshot_file for this snap is: volume-642e2e22-ad3e-4317-9d10-a49f23436716.bd98b81a-a1e9-4b34-bca4-c2d1e504c037 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c66f5532-4914-46ca-b2ae-f2acd50e23a7 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.459s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-c66f5532-4914-46ca-b2ae-f2acd50e23a7 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d2298bce-745f-48ea-a61a-a412910dcbf7 tempest-VolumeImageDependencyTests-1492885087 None] Lock "cinder-quobyte-edace9d7-c2fb-419c-8ded-ff99ab9b606d" acquired by "delete_volume" :: waited 0.052s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:24 devstack sudo[107274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c3946995-df9f-42c4-ae9c-0b88ac23b69d
Nov 05 15:23:24 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba4ee25-1b18-4ccc-bd72-71d01dcb2972]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a8f35375-593a-4b31-b9b4-5c56466dd9c4 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.bd98b81a-a1e9-4b34-bca4-c2d1e504c037 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:24 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c66f5532-4914-46ca-b2ae-f2acd50e23a7 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Deleted volume successfully.
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d837a6af-7f08-4dd6-84b9-d72961af734a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d2298bce-745f-48ea-a61a-a412910dcbf7 tempest-VolumeImageDependencyTests-1492885087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-edace9d7-c2fb-419c-8ded-ff99ab9b606d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c66f5532-4914-46ca-b2ae-f2acd50e23a7 tempest-CreateVolumesFromSourceVolumeTest-1130422943 None] Lock "cinder-0f884c94-c827-485a-acfa-709349910422-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:24 devstack sudo[107277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.bd98b81a-a1e9-4b34-bca4-c2d1e504c037
Nov 05 15:23:24 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:25 devstack sudo[107278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-edace9d7-c2fb-419c-8ded-ff99ab9b606d
Nov 05 15:23:25 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:25 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e0dd573b-51ea-452d-a5b5-230b9da2cdc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c3946995-df9f-42c4-ae9c-0b88ac23b69d" returned: 0 in 0.510s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e0dd573b-51ea-452d-a5b5-230b9da2cdc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c3946995-df9f-42c4-ae9c-0b88ac23b69d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:25 devstack sudo[107285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c3946995-df9f-42c4-ae9c-0b88ac23b69d
Nov 05 15:23:25 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:25 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a8f35375-593a-4b31-b9b4-5c56466dd9c4 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.bd98b81a-a1e9-4b34-bca4-c2d1e504c037" returned: 0 in 0.423s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a8f35375-593a-4b31-b9b4-5c56466dd9c4 tempest-ProjectMemberTests-340429542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-642e2e22-ad3e-4317-9d10-a49f23436716(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6909ef38-834e-4d26-a72b-82492d1f784c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a8f35375-593a-4b31-b9b4-5c56466dd9c4 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:25 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d2298bce-745f-48ea-a61a-a412910dcbf7 tempest-VolumeImageDependencyTests-1492885087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-edace9d7-c2fb-419c-8ded-ff99ab9b606d" returned: 0 in 0.459s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d2298bce-745f-48ea-a61a-a412910dcbf7 tempest-VolumeImageDependencyTests-1492885087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-edace9d7-c2fb-419c-8ded-ff99ab9b606d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:25 devstack sudo[107295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-edace9d7-c2fb-419c-8ded-ff99ab9b606d
Nov 05 15:23:25 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:25 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e0dd573b-51ea-452d-a5b5-230b9da2cdc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c3946995-df9f-42c4-ae9c-0b88ac23b69d" returned: 0 in 0.287s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e0dd573b-51ea-452d-a5b5-230b9da2cdc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-quobyte-c3946995-df9f-42c4-ae9c-0b88ac23b69d" released by "delete_volume" :: held 0.863s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:25 devstack sudo[107294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716
Nov 05 15:23:25 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-e0dd573b-51ea-452d-a5b5-230b9da2cdc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Created reservations ['290ef38f-e01e-4ff5-bffe-b1d67940a986', '4b02e8fe-b737-4f0e-959f-fe897392120a', '1dc4a2b1-b795-418e-b61f-77550d1703f7', '759d7a0c-84c4-4c56-b495-cf2b2d70819e'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e0dd573b-51ea-452d-a5b5-230b9da2cdc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e0dd573b-51ea-452d-a5b5-230b9da2cdc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e0dd573b-51ea-452d-a5b5-230b9da2cdc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e0dd573b-51ea-452d-a5b5-230b9da2cdc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e0dd573b-51ea-452d-a5b5-230b9da2cdc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e0dd573b-51ea-452d-a5b5-230b9da2cdc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:25 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d2298bce-745f-48ea-a61a-a412910dcbf7 tempest-VolumeImageDependencyTests-1492885087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-edace9d7-c2fb-419c-8ded-ff99ab9b606d" returned: 0 in 0.427s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:25 devstack sudo[107334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:23:25 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d2298bce-745f-48ea-a61a-a412910dcbf7 tempest-VolumeImageDependencyTests-1492885087 None] Lock "cinder-quobyte-edace9d7-c2fb-419c-8ded-ff99ab9b606d" released by "delete_volume" :: held 0.986s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-d2298bce-745f-48ea-a61a-a412910dcbf7 tempest-VolumeImageDependencyTests-1492885087 None] Created reservations ['1d8a9146-954a-446e-8993-c6a197d78769', '7f407cdf-354f-4943-bfdb-c054de30af8e', '71686c81-3985-4e83-9785-274b6f853c1d', '3dcf0e54-5f5b-48a7-b869-d925b185e9d2'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:25 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a8f35375-593a-4b31-b9b4-5c56466dd9c4 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716" returned: 0 in 0.662s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a8f35375-593a-4b31-b9b4-5c56466dd9c4 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.bd98b81a-a1e9-4b34-bca4-c2d1e504c037 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d2298bce-745f-48ea-a61a-a412910dcbf7 tempest-VolumeImageDependencyTests-1492885087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d2298bce-745f-48ea-a61a-a412910dcbf7 tempest-VolumeImageDependencyTests-1492885087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d2298bce-745f-48ea-a61a-a412910dcbf7 tempest-VolumeImageDependencyTests-1492885087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d2298bce-745f-48ea-a61a-a412910dcbf7 tempest-VolumeImageDependencyTests-1492885087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d2298bce-745f-48ea-a61a-a412910dcbf7 tempest-VolumeImageDependencyTests-1492885087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d2298bce-745f-48ea-a61a-a412910dcbf7 tempest-VolumeImageDependencyTests-1492885087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:25 devstack sudo[107339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.bd98b81a-a1e9-4b34-bca4-c2d1e504c037
Nov 05 15:23:25 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:26 devstack sudo[107340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:23:26 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:26 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e0dd573b-51ea-452d-a5b5-230b9da2cdc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.423s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:26 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-e0dd573b-51ea-452d-a5b5-230b9da2cdc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:23:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e0dd573b-51ea-452d-a5b5-230b9da2cdc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Deleted volume successfully.
Nov 05 15:23:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e0dd573b-51ea-452d-a5b5-230b9da2cdc2 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-c3946995-df9f-42c4-ae9c-0b88ac23b69d-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:26 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d2298bce-745f-48ea-a61a-a412910dcbf7 tempest-VolumeImageDependencyTests-1492885087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.331s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:26 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-d2298bce-745f-48ea-a61a-a412910dcbf7 tempest-VolumeImageDependencyTests-1492885087 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:23:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d2298bce-745f-48ea-a61a-a412910dcbf7 tempest-VolumeImageDependencyTests-1492885087 None] Deleted volume successfully.
Nov 05 15:23:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d2298bce-745f-48ea-a61a-a412910dcbf7 tempest-VolumeImageDependencyTests-1492885087 None] Lock "cinder-edace9d7-c2fb-419c-8ded-ff99ab9b606d-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:26 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a8f35375-593a-4b31-b9b4-5c56466dd9c4 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.bd98b81a-a1e9-4b34-bca4-c2d1e504c037" returned: 0 in 0.433s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a8f35375-593a-4b31-b9b4-5c56466dd9c4 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.bd98b81a-a1e9-4b34-bca4-c2d1e504c037 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:26 devstack sudo[107350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.bd98b81a-a1e9-4b34-bca4-c2d1e504c037
Nov 05 15:23:26 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:26 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a8f35375-593a-4b31-b9b4-5c56466dd9c4 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716.bd98b81a-a1e9-4b34-bca4-c2d1e504c037" returned: 0 in 0.260s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a8f35375-593a-4b31-b9b4-5c56466dd9c4 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-bd98b81a-a1e9-4b34-bca4-c2d1e504c037" released by "_delete_snapshot" :: held 1.943s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-58eac85d-3774-4649-90b8-57b6b2c3d716 tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "cinder-fcb01e94-abd5-43df-a4fc-d31149610267-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a8f35375-593a-4b31-b9b4-5c56466dd9c4 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-642e2e22-ad3e-4317-9d10-a49f23436716" released by "delete_snapshot" :: held 2.011s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-58eac85d-3774-4649-90b8-57b6b2c3d716 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-fcb01e94-abd5-43df-a4fc-d31149610267-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-58eac85d-3774-4649-90b8-57b6b2c3d716 tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "cinder-quobyte-fcb01e94-abd5-43df-a4fc-d31149610267" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-58eac85d-3774-4649-90b8-57b6b2c3d716 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-quobyte-fcb01e94-abd5-43df-a4fc-d31149610267" acquired by "delete_volume" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:26 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a78ae6-9069-47c3-a5f6-76879ec334dd]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58eac85d-3774-4649-90b8-57b6b2c3d716 tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fcb01e94-abd5-43df-a4fc-d31149610267 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:26 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-a8f35375-593a-4b31-b9b4-5c56466dd9c4 tempest-ProjectMemberTests-340429542 None] Created reservations ['f7ca988b-81dd-4548-9465-e5ce2a45537c', '596394a3-ab6d-40b9-b601-4556abb1adc8', 'a27aa46c-a6a0-4412-bb15-a8a48ef33e72', 'a81265d4-9002-402c-8764-f8eea015bc82'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a8f35375-593a-4b31-b9b4-5c56466dd9c4 tempest-ProjectMemberTests-340429542 None] Delete snapshot completed successfully.
Nov 05 15:23:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a8f35375-593a-4b31-b9b4-5c56466dd9c4 tempest-ProjectMemberTests-340429542 None] Lock "cinder-bd98b81a-a1e9-4b34-bca4-c2d1e504c037-delete_snapshot" released by "delete_snapshot" :: held 2.272s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:27 devstack sudo[107353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fcb01e94-abd5-43df-a4fc-d31149610267
Nov 05 15:23:27 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:27 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58eac85d-3774-4649-90b8-57b6b2c3d716 tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fcb01e94-abd5-43df-a4fc-d31149610267" returned: 0 in 0.425s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58eac85d-3774-4649-90b8-57b6b2c3d716 tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fcb01e94-abd5-43df-a4fc-d31149610267 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:27 devstack sudo[107358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fcb01e94-abd5-43df-a4fc-d31149610267
Nov 05 15:23:27 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:27 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58eac85d-3774-4649-90b8-57b6b2c3d716 tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-fcb01e94-abd5-43df-a4fc-d31149610267" returned: 0 in 0.288s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-58eac85d-3774-4649-90b8-57b6b2c3d716 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-quobyte-fcb01e94-abd5-43df-a4fc-d31149610267" released by "delete_volume" :: held 0.782s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:27 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-58eac85d-3774-4649-90b8-57b6b2c3d716 tempest-CreateVolumesFromSnapshotTest-501279056 None] Created reservations ['9b451d4e-60f0-42c7-8ce0-0d4a419bdcec', '37dc4634-ca62-4cd4-b07a-bac8e9a22ae5', 'e44c6100-80c5-4aef-9a9f-e003058d032a', '7a40e77b-b3ca-4aa2-9091-02dba50e7074'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-58eac85d-3774-4649-90b8-57b6b2c3d716 tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-58eac85d-3774-4649-90b8-57b6b2c3d716 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-58eac85d-3774-4649-90b8-57b6b2c3d716 tempest-CreateVolumesFromSnapshotTest-501279056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-58eac85d-3774-4649-90b8-57b6b2c3d716 tempest-CreateVolumesFromSnapshotTest-501279056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-58eac85d-3774-4649-90b8-57b6b2c3d716 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58eac85d-3774-4649-90b8-57b6b2c3d716 tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:27 devstack sudo[107361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:23:27 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e3fd182a-0903-449e-a7aa-04cef3761a1e tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "cinder-7f8751b2-abbe-49ca-bd4e-b02d037d06c0-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e3fd182a-0903-449e-a7aa-04cef3761a1e tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-7f8751b2-abbe-49ca-bd4e-b02d037d06c0-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e3fd182a-0903-449e-a7aa-04cef3761a1e tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "cinder-quobyte-7f8751b2-abbe-49ca-bd4e-b02d037d06c0" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e3fd182a-0903-449e-a7aa-04cef3761a1e tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-quobyte-7f8751b2-abbe-49ca-bd4e-b02d037d06c0" acquired by "delete_volume" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:28 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-58eac85d-3774-4649-90b8-57b6b2c3d716 tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.391s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-58eac85d-3774-4649-90b8-57b6b2c3d716 tempest-CreateVolumesFromSnapshotTest-501279056 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:23:28 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-58eac85d-3774-4649-90b8-57b6b2c3d716 tempest-CreateVolumesFromSnapshotTest-501279056 None] Deleted volume successfully.
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24998d1-d1de-43e0-89e7-af4880fbb4c4]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e3fd182a-0903-449e-a7aa-04cef3761a1e tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7f8751b2-abbe-49ca-bd4e-b02d037d06c0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-58eac85d-3774-4649-90b8-57b6b2c3d716 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-fcb01e94-abd5-43df-a4fc-d31149610267-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1ca99968-ec03-4fbc-ad11-2ca745b1cc03 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-642e2e22-ad3e-4317-9d10-a49f23436716-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1ca99968-ec03-4fbc-ad11-2ca745b1cc03 tempest-ProjectMemberTests-340429542 None] Lock "cinder-642e2e22-ad3e-4317-9d10-a49f23436716-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:28 devstack sudo[107364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7f8751b2-abbe-49ca-bd4e-b02d037d06c0
Nov 05 15:23:28 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1ca99968-ec03-4fbc-ad11-2ca745b1cc03 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-642e2e22-ad3e-4317-9d10-a49f23436716" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1ca99968-ec03-4fbc-ad11-2ca745b1cc03 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-642e2e22-ad3e-4317-9d10-a49f23436716" acquired by "delete_volume" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ffa248-e001-4dea-b8af-92902d952cd4]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ca99968-ec03-4fbc-ad11-2ca745b1cc03 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Flow 'volume_create_manager' (5bea8767-5b06-47df-9d1d-90790a86174e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dcc9e03-e7bb-4c51-89ef-5b30c3b5fc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dcc9e03-e7bb-4c51-89ef-5b30c3b5fc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a92a8949fbbf4310826a6a961fadd0f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:28Z,use_quota=True,user_id='b0103154c1c34c67b35eb75d00fc5fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3871c1b-7ec9-4742-be93-5ad0f1904d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3871c1b-7ec9-4742-be93-5ad0f1904d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88044372-f9e4-40e8-8797-8e56a933d015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88044372-f9e4-40e8-8797-8e56a933d015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a', 'volume_name': 'volume-5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143b0602-4904-4c91-aa8e-1544a8b98e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143b0602-4904-4c91-aa8e-1544a8b98e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b48a7b3-f44f-4e8d-ba2a-fb45501f6f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:28 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Volume 5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a', 'volume_size': 1}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:28 devstack sudo[107366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a92a8949fbbf4310826a6a961fadd0f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:28Z,use_quota=True,user_id='b0103154c1c34c67b35eb75d00fc5fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Creating volume 5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:23:28 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:23:28 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:28 devstack sudo[107372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a 1073741824
Nov 05 15:23:28 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:28 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e3fd182a-0903-449e-a7aa-04cef3761a1e tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7f8751b2-abbe-49ca-bd4e-b02d037d06c0" returned: 0 in 0.534s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e3fd182a-0903-449e-a7aa-04cef3761a1e tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7f8751b2-abbe-49ca-bd4e-b02d037d06c0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:28 devstack sudo[107374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7f8751b2-abbe-49ca-bd4e-b02d037d06c0
Nov 05 15:23:28 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:28 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ca99968-ec03-4fbc-ad11-2ca745b1cc03 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716" returned: 0 in 0.492s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ca99968-ec03-4fbc-ad11-2ca745b1cc03 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:29 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e3fd182a-0903-449e-a7aa-04cef3761a1e tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7f8751b2-abbe-49ca-bd4e-b02d037d06c0" returned: 0 in 0.327s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:29 devstack sudo[107384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716
Nov 05 15:23:29 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e3fd182a-0903-449e-a7aa-04cef3761a1e tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-quobyte-7f8751b2-abbe-49ca-bd4e-b02d037d06c0" released by "delete_volume" :: held 0.945s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-e3fd182a-0903-449e-a7aa-04cef3761a1e tempest-CreateVolumesFromSnapshotTest-501279056 None] Created reservations ['c573c2ea-840c-4173-92f2-3665f609a906', '2399358f-1957-4f57-9709-f20ca09ed67d', '65e55a19-31a0-4a02-ba66-27320ffa6907', 'db932d33-51f7-44e9-a223-8ffef415dcf4'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e3fd182a-0903-449e-a7aa-04cef3761a1e tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e3fd182a-0903-449e-a7aa-04cef3761a1e tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e3fd182a-0903-449e-a7aa-04cef3761a1e tempest-CreateVolumesFromSnapshotTest-501279056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e3fd182a-0903-449e-a7aa-04cef3761a1e tempest-CreateVolumesFromSnapshotTest-501279056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e3fd182a-0903-449e-a7aa-04cef3761a1e tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e3fd182a-0903-449e-a7aa-04cef3761a1e tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:29 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ccbece12-9a1d-4aeb-9fe9-403c035cf60c tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "cinder-2f37c871-8d22-469f-8932-4fb98fd04a2e-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:29 devstack sudo[107386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:23:29 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a 1073741824" returned: 0 in 0.632s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ccbece12-9a1d-4aeb-9fe9-403c035cf60c tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-2f37c871-8d22-469f-8932-4fb98fd04a2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ccbece12-9a1d-4aeb-9fe9-403c035cf60c tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "cinder-quobyte-95df3bfd-367b-42e8-b66d-9ced5028ea8b" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ccbece12-9a1d-4aeb-9fe9-403c035cf60c tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-quobyte-95df3bfd-367b-42e8-b66d-9ced5028ea8b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ccbece12-9a1d-4aeb-9fe9-403c035cf60c tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "cinder-quobyte-2f37c871-8d22-469f-8932-4fb98fd04a2e" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ccbece12-9a1d-4aeb-9fe9-403c035cf60c tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-quobyte-2f37c871-8d22-469f-8932-4fb98fd04a2e" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ccbece12-9a1d-4aeb-9fe9-403c035cf60c tempest-CreateVolumesFromSnapshotTest-501279056 None] Deleting offline snapshot 2f37c871-8d22-469f-8932-4fb98fd04a2e of volume 95df3bfd-367b-42e8-b66d-9ced5028ea8b {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:23:29 devstack sudo[107389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a
Nov 05 15:23:29 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:29 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ccbece12-9a1d-4aeb-9fe9-403c035cf60c tempest-CreateVolumesFromSnapshotTest-501279056 None] snapshot_file for this snap is: volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.2f37c871-8d22-469f-8932-4fb98fd04a2e {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ca99968-ec03-4fbc-ad11-2ca745b1cc03 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-642e2e22-ad3e-4317-9d10-a49f23436716" returned: 0 in 0.457s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[764db5c3-1dcb-477d-94d5-1313232bfe16]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ccbece12-9a1d-4aeb-9fe9-403c035cf60c tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.2f37c871-8d22-469f-8932-4fb98fd04a2e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1ca99968-ec03-4fbc-ad11-2ca745b1cc03 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-642e2e22-ad3e-4317-9d10-a49f23436716" released by "delete_volume" :: held 1.071s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-1ca99968-ec03-4fbc-ad11-2ca745b1cc03 tempest-ProjectMemberTests-340429542 None] Created reservations ['8dc617e5-cfb0-4d71-9672-03dc175d7868', 'a3cc4ee2-59c5-42af-a9ec-84ae4cbfc3ac', '0221eb12-b84e-43c0-bf63-0b42eda4f3f1', '3575b22c-b26f-4e14-a762-5d3364477ee5'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:29 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e3fd182a-0903-449e-a7aa-04cef3761a1e tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.411s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-e3fd182a-0903-449e-a7aa-04cef3761a1e tempest-CreateVolumesFromSnapshotTest-501279056 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:23:29 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e3fd182a-0903-449e-a7aa-04cef3761a1e tempest-CreateVolumesFromSnapshotTest-501279056 None] Deleted volume successfully.
Nov 05 15:23:29 devstack sudo[107392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.2f37c871-8d22-469f-8932-4fb98fd04a2e
Nov 05 15:23:29 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e3fd182a-0903-449e-a7aa-04cef3761a1e tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-7f8751b2-abbe-49ca-bd4e-b02d037d06c0-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1ca99968-ec03-4fbc-ad11-2ca745b1cc03 tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1ca99968-ec03-4fbc-ad11-2ca745b1cc03 tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1ca99968-ec03-4fbc-ad11-2ca745b1cc03 tempest-ProjectMemberTests-340429542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:29 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1ca99968-ec03-4fbc-ad11-2ca745b1cc03 tempest-ProjectMemberTests-340429542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1ca99968-ec03-4fbc-ad11-2ca745b1cc03 tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ca99968-ec03-4fbc-ad11-2ca745b1cc03 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a" returned: 0 in 0.381s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:29 devstack sudo[107396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:23:29 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b48a7b3-f44f-4e8d-ba2a-fb45501f6f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5edfb9d-dc1e-48cb-8131-0655f7ab1a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:29 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Volume volume-5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a (5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a): created successfully
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5edfb9d-dc1e-48cb-8131-0655f7ab1a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Flow 'volume_create_manager' (5bea8767-5b06-47df-9d1d-90790a86174e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:29 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-961e8070-fb57-43c1-9ccd-abe0b3330d9f tempest-CinderUnicodeTest-873075726 None] Created volume successfully.
Nov 05 15:23:29 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ccbece12-9a1d-4aeb-9fe9-403c035cf60c tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.2f37c871-8d22-469f-8932-4fb98fd04a2e" returned: 0 in 0.500s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ccbece12-9a1d-4aeb-9fe9-403c035cf60c tempest-CreateVolumesFromSnapshotTest-501279056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:23:30 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[be463e63-645a-4982-ad23-1d87f576027f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ccbece12-9a1d-4aeb-9fe9-403c035cf60c tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:30 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ca99968-ec03-4fbc-ad11-2ca745b1cc03 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.329s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:30 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-1ca99968-ec03-4fbc-ad11-2ca745b1cc03 tempest-ProjectMemberTests-340429542 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:23:30 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1ca99968-ec03-4fbc-ad11-2ca745b1cc03 tempest-ProjectMemberTests-340429542 None] Deleted volume successfully.
Nov 05 15:23:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1ca99968-ec03-4fbc-ad11-2ca745b1cc03 tempest-ProjectMemberTests-340429542 None] Lock "cinder-642e2e22-ad3e-4317-9d10-a49f23436716-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:30 devstack sudo[107402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b
Nov 05 15:23:30 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:30 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ccbece12-9a1d-4aeb-9fe9-403c035cf60c tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b" returned: 0 in 0.384s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ccbece12-9a1d-4aeb-9fe9-403c035cf60c tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.2f37c871-8d22-469f-8932-4fb98fd04a2e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:30 devstack sudo[107408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.2f37c871-8d22-469f-8932-4fb98fd04a2e
Nov 05 15:23:30 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:30 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ccbece12-9a1d-4aeb-9fe9-403c035cf60c tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.2f37c871-8d22-469f-8932-4fb98fd04a2e" returned: 0 in 0.468s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ccbece12-9a1d-4aeb-9fe9-403c035cf60c tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.2f37c871-8d22-469f-8932-4fb98fd04a2e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:30 devstack sudo[107413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.2f37c871-8d22-469f-8932-4fb98fd04a2e
Nov 05 15:23:30 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:31 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ccbece12-9a1d-4aeb-9fe9-403c035cf60c tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b.2f37c871-8d22-469f-8932-4fb98fd04a2e" returned: 0 in 0.358s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Flow 'volume_create_manager' (7409a7b8-5209-42c4-b1d8-a9ae92310e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e926ac-b637-49e5-8205-8d2288a2b4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ccbece12-9a1d-4aeb-9fe9-403c035cf60c tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-quobyte-2f37c871-8d22-469f-8932-4fb98fd04a2e" released by "_delete_snapshot" :: held 1.954s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ccbece12-9a1d-4aeb-9fe9-403c035cf60c tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-quobyte-95df3bfd-367b-42e8-b66d-9ced5028ea8b" released by "delete_snapshot" :: held 1.998s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e926ac-b637-49e5-8205-8d2288a2b4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-980064800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb562e7-0989-403f-9b8e-777ef74bdfc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9e03f4a164bf48042da27edfd742d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:31Z,use_quota=True,user_id='d3585054b64542a1a174061b1731d371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58b77ca-69ba-48a4-9894-a324d6fe1e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58b77ca-69ba-48a4-9894-a324d6fe1e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24a8263-fc75-43e7-843e-49baa4b61112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24a8263-fc75-43e7-843e-49baa4b61112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eb562e7-0989-403f-9b8e-777ef74bdfc6', 'volume_name': 'volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ad7dc7-7593-4db6-aa17-58321341bb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ad7dc7-7593-4db6-aa17-58321341bb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ced5a1a8-548b-4a69-828e-f98d214dfbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:31 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Volume 6eb562e7-0989-403f-9b8e-777ef74bdfc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6', 'volume_size': 1}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-980064800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb562e7-0989-403f-9b8e-777ef74bdfc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9e03f4a164bf48042da27edfd742d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:31Z,use_quota=True,user_id='d3585054b64542a1a174061b1731d371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Creating volume 6eb562e7-0989-403f-9b8e-777ef74bdfc6 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:23:31 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:31 devstack sudo[107416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6 1073741824
Nov 05 15:23:31 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Flow 'volume_create_manager' (062cc72b-82f0-4f21-8c4b-b1ecee9e49e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2207797-a126-4e68-889c-c0daf0e47a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2207797-a126-4e68-889c-c0daf0e47a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1045190245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6122afb4-a242-4f30-9541-7f7feb2f4a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a92a8949fbbf4310826a6a961fadd0f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:31Z,use_quota=True,user_id='b0103154c1c34c67b35eb75d00fc5fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8307cbb1-7308-46ec-9074-349214205893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8307cbb1-7308-46ec-9074-349214205893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a731c825-cead-45ae-a5e8-40e68468ee4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a731c825-cead-45ae-a5e8-40e68468ee4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6122afb4-a242-4f30-9541-7f7feb2f4a63', 'volume_name': 'volume-6122afb4-a242-4f30-9541-7f7feb2f4a63', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf51817-3fe9-4ed7-ab25-624de984e7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf51817-3fe9-4ed7-ab25-624de984e7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da99b2ae-750d-4bb0-ae7f-2498dfec0cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:31 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Volume 6122afb4-a242-4f30-9541-7f7feb2f4a63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6122afb4-a242-4f30-9541-7f7feb2f4a63', 'volume_size': 1}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-ccbece12-9a1d-4aeb-9fe9-403c035cf60c tempest-CreateVolumesFromSnapshotTest-501279056 None] Created reservations ['d38391f6-2eb8-44d4-b7d5-95ab1c0577c4', 'f8dc2185-0a93-4800-ba13-d7352bf033b8', '27776f06-9245-4fe7-831c-a1fdcc81d0bd', '4dbcba55-a1e6-4070-96cb-52643bcbb094'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:31 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ccbece12-9a1d-4aeb-9fe9-403c035cf60c tempest-CreateVolumesFromSnapshotTest-501279056 None] Delete snapshot completed successfully.
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ccbece12-9a1d-4aeb-9fe9-403c035cf60c tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-2f37c871-8d22-469f-8932-4fb98fd04a2e-delete_snapshot" released by "delete_snapshot" :: held 2.342s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:31 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6 1073741824" returned: 0 in 0.477s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:31 devstack sudo[107422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6
Nov 05 15:23:31 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:32 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6" returned: 0 in 0.256s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.620s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1045190245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6122afb4-a242-4f30-9541-7f7feb2f4a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a92a8949fbbf4310826a6a961fadd0f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:31Z,use_quota=True,user_id='b0103154c1c34c67b35eb75d00fc5fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Creating volume 6122afb4-a242-4f30-9541-7f7feb2f4a63 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:23:32 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ced5a1a8-548b-4a69-828e-f98d214dfbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:32 devstack sudo[107425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63 1073741824
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1baefb01-5542-463c-92c4-34c0d5102180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:32 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:32 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Volume volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6 (6eb562e7-0989-403f-9b8e-777ef74bdfc6): created successfully
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1baefb01-5542-463c-92c4-34c0d5102180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Flow 'volume_create_manager' (7409a7b8-5209-42c4-b1d8-a9ae92310e83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:32 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-81ee5f0d-e922-49ac-991d-c55485eb1dcd tempest-ProjectMemberTests-340429542 None] Created volume successfully.
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-61190681-4646-480c-8973-6b7685f83ac6 tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "cinder-95df3bfd-367b-42e8-b66d-9ced5028ea8b-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-61190681-4646-480c-8973-6b7685f83ac6 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-95df3bfd-367b-42e8-b66d-9ced5028ea8b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-61190681-4646-480c-8973-6b7685f83ac6 tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "cinder-quobyte-95df3bfd-367b-42e8-b66d-9ced5028ea8b" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-61190681-4646-480c-8973-6b7685f83ac6 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-quobyte-95df3bfd-367b-42e8-b66d-9ced5028ea8b" acquired by "delete_volume" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c7588a-f850-4826-ad6d-c0903b48eea1]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-61190681-4646-480c-8973-6b7685f83ac6 tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:32 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63 1073741824" returned: 0 in 0.534s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:32 devstack sudo[107431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b
Nov 05 15:23:32 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:32 devstack sudo[107433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63
Nov 05 15:23:32 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:33 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63" returned: 0 in 0.268s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:33 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-61190681-4646-480c-8973-6b7685f83ac6 tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b" returned: 0 in 0.411s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-61190681-4646-480c-8973-6b7685f83ac6 tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da99b2ae-750d-4bb0-ae7f-2498dfec0cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6122afb4-a242-4f30-9541-7f7feb2f4a63', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d368f24c-76f8-44ee-a9b0-4f2ed4cf6b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:33 devstack sudo[107439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b
Nov 05 15:23:33 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:33 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Volume volume-6122afb4-a242-4f30-9541-7f7feb2f4a63 (6122afb4-a242-4f30-9541-7f7feb2f4a63): created successfully
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d368f24c-76f8-44ee-a9b0-4f2ed4cf6b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Flow 'volume_create_manager' (062cc72b-82f0-4f21-8c4b-b1ecee9e49e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:33 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-cf30ee49-c699-45dc-9cfe-1b277fc50f8b tempest-CinderUnicodeTest-873075726 None] Created volume successfully.
Nov 05 15:23:33 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-61190681-4646-480c-8973-6b7685f83ac6 tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-95df3bfd-367b-42e8-b66d-9ced5028ea8b" returned: 0 in 0.291s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-61190681-4646-480c-8973-6b7685f83ac6 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-quobyte-95df3bfd-367b-42e8-b66d-9ced5028ea8b" released by "delete_volume" :: held 0.785s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-61190681-4646-480c-8973-6b7685f83ac6 tempest-CreateVolumesFromSnapshotTest-501279056 None] Created reservations ['ca110145-b327-4ae3-8a76-710f6dc2658c', '9b0d6eae-ed4e-4c28-baf3-5f9fb95f10cb', 'f5968929-da20-4179-aa28-1142dc9444b1', 'c1a60aa5-8f05-4472-ba75-e3d7cdf6dbff'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ec4292ac-1e30-431f-84a5-7149bbfd413e tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ec4292ac-1e30-431f-84a5-7149bbfd413e tempest-ProjectMemberTests-340429542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-61190681-4646-480c-8973-6b7685f83ac6 tempest-CreateVolumesFromSnapshotTest-501279056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-61190681-4646-480c-8973-6b7685f83ac6 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-61190681-4646-480c-8973-6b7685f83ac6 tempest-CreateVolumesFromSnapshotTest-501279056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-61190681-4646-480c-8973-6b7685f83ac6 tempest-CreateVolumesFromSnapshotTest-501279056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-61190681-4646-480c-8973-6b7685f83ac6 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-61190681-4646-480c-8973-6b7685f83ac6 tempest-CreateVolumesFromSnapshotTest-501279056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ec4292ac-1e30-431f-84a5-7149bbfd413e tempest-ProjectMemberTests-340429542 None] Creating offline snapshot bc0a1533-0cd5-4db7-a557-152b8cd99b14 of volume 6eb562e7-0989-403f-9b8e-777ef74bdfc6 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:23:33 devstack sudo[107442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:23:33 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[32be457c-2426-41a0-be26-297c758378b5]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ec4292ac-1e30-431f-84a5-7149bbfd413e tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:33 devstack sudo[107444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6
Nov 05 15:23:33 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f2e2d56c-abc6-4abf-92a1-d92f0a5c5534 tempest-CinderUnicodeTest-873075726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:33 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-61190681-4646-480c-8973-6b7685f83ac6 tempest-CreateVolumesFromSnapshotTest-501279056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.393s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:33 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-61190681-4646-480c-8973-6b7685f83ac6 tempest-CreateVolumesFromSnapshotTest-501279056 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:23:33 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-61190681-4646-480c-8973-6b7685f83ac6 tempest-CreateVolumesFromSnapshotTest-501279056 None] Deleted volume successfully.
Nov 05 15:23:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-61190681-4646-480c-8973-6b7685f83ac6 tempest-CreateVolumesFromSnapshotTest-501279056 None] Lock "cinder-95df3bfd-367b-42e8-b66d-9ced5028ea8b-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:34 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ec4292ac-1e30-431f-84a5-7149bbfd413e tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6" returned: 0 in 0.602s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ec4292ac-1e30-431f-84a5-7149bbfd413e tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.bc0a1533-0cd5-4db7-a557-152b8cd99b14 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:34 devstack sudo[107450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.bc0a1533-0cd5-4db7-a557-152b8cd99b14 1G
Nov 05 15:23:34 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:34 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ec4292ac-1e30-431f-84a5-7149bbfd413e tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.bc0a1533-0cd5-4db7-a557-152b8cd99b14 1G" returned: 0 in 0.495s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ec4292ac-1e30-431f-84a5-7149bbfd413e tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.bc0a1533-0cd5-4db7-a557-152b8cd99b14 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:34 devstack sudo[107456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.bc0a1533-0cd5-4db7-a557-152b8cd99b14
Nov 05 15:23:34 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:35 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ec4292ac-1e30-431f-84a5-7149bbfd413e tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.bc0a1533-0cd5-4db7-a557-152b8cd99b14" returned: 0 in 0.353s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:35 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-ec4292ac-1e30-431f-84a5-7149bbfd413e tempest-ProjectMemberTests-340429542 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.bc0a1533-0cd5-4db7-a557-152b8cd99b14 is being set with open permissions: ugo+rw
Nov 05 15:23:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ec4292ac-1e30-431f-84a5-7149bbfd413e tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.bc0a1533-0cd5-4db7-a557-152b8cd99b14 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:35 devstack sudo[107461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.bc0a1533-0cd5-4db7-a557-152b8cd99b14
Nov 05 15:23:35 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:35 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ec4292ac-1e30-431f-84a5-7149bbfd413e tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.bc0a1533-0cd5-4db7-a557-152b8cd99b14" returned: 0 in 0.264s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ec4292ac-1e30-431f-84a5-7149bbfd413e tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:35 devstack sudo[107464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.info
Nov 05 15:23:35 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:35 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ec4292ac-1e30-431f-84a5-7149bbfd413e tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.info" returned: 0 in 0.295s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:35 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-ec4292ac-1e30-431f-84a5-7149bbfd413e tempest-ProjectMemberTests-340429542 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.info is being set with open permissions: ugo+rw
Nov 05 15:23:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ec4292ac-1e30-431f-84a5-7149bbfd413e tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:35 devstack sudo[107467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.info
Nov 05 15:23:35 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:35 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ec4292ac-1e30-431f-84a5-7149bbfd413e tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.info" returned: 0 in 0.278s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ec4292ac-1e30-431f-84a5-7149bbfd413e tempest-ProjectMemberTests-340429542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.447s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f2e2d56c-abc6-4abf-92a1-d92f0a5c5534 tempest-CinderUnicodeTest-873075726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.084s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-f2e2d56c-abc6-4abf-92a1-d92f0a5c5534 tempest-CinderUnicodeTest-873075726 None] Creating offline snapshot 214be29e-6d5a-456f-ab52-4c8170480f42 of volume 6122afb4-a242-4f30-9541-7f7feb2f4a63 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:23:36 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ec4292ac-1e30-431f-84a5-7149bbfd413e tempest-ProjectMemberTests-340429542 None] Create snapshot completed successfully
Nov 05 15:23:36 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcb667a-9373-4f17-a79d-78449176a76d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f2e2d56c-abc6-4abf-92a1-d92f0a5c5534 tempest-CinderUnicodeTest-873075726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:36 devstack sudo[107470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63
Nov 05 15:23:36 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:36 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f2e2d56c-abc6-4abf-92a1-d92f0a5c5534 tempest-CinderUnicodeTest-873075726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63" returned: 0 in 0.399s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f2e2d56c-abc6-4abf-92a1-d92f0a5c5534 tempest-CinderUnicodeTest-873075726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.214be29e-6d5a-456f-ab52-4c8170480f42 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:36 devstack sudo[107475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.214be29e-6d5a-456f-ab52-4c8170480f42 1G
Nov 05 15:23:36 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-777363ec-2802-46c7-8a22-57986fe730b0 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-bc0a1533-0cd5-4db7-a557-152b8cd99b14-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-777363ec-2802-46c7-8a22-57986fe730b0 tempest-ProjectMemberTests-340429542 None] Lock "cinder-bc0a1533-0cd5-4db7-a557-152b8cd99b14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-777363ec-2802-46c7-8a22-57986fe730b0 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-6eb562e7-0989-403f-9b8e-777ef74bdfc6" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-777363ec-2802-46c7-8a22-57986fe730b0 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-6eb562e7-0989-403f-9b8e-777ef74bdfc6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-777363ec-2802-46c7-8a22-57986fe730b0 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-bc0a1533-0cd5-4db7-a557-152b8cd99b14" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-777363ec-2802-46c7-8a22-57986fe730b0 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-bc0a1533-0cd5-4db7-a557-152b8cd99b14" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-777363ec-2802-46c7-8a22-57986fe730b0 tempest-ProjectMemberTests-340429542 None] Deleting offline snapshot bc0a1533-0cd5-4db7-a557-152b8cd99b14 of volume 6eb562e7-0989-403f-9b8e-777ef74bdfc6 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:23:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-777363ec-2802-46c7-8a22-57986fe730b0 tempest-ProjectMemberTests-340429542 None] snapshot_file for this snap is: volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.bc0a1533-0cd5-4db7-a557-152b8cd99b14 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:23:36 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7502114d-e316-4903-b5a5-8f2a31c30ca1]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-777363ec-2802-46c7-8a22-57986fe730b0 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.bc0a1533-0cd5-4db7-a557-152b8cd99b14 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:36 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f2e2d56c-abc6-4abf-92a1-d92f0a5c5534 tempest-CinderUnicodeTest-873075726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.214be29e-6d5a-456f-ab52-4c8170480f42 1G" returned: 0 in 0.530s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f2e2d56c-abc6-4abf-92a1-d92f0a5c5534 tempest-CinderUnicodeTest-873075726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6122afb4-a242-4f30-9541-7f7feb2f4a63 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.214be29e-6d5a-456f-ab52-4c8170480f42 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:36 devstack sudo[107480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.bc0a1533-0cd5-4db7-a557-152b8cd99b14
Nov 05 15:23:36 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:36 devstack sudo[107482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6122afb4-a242-4f30-9541-7f7feb2f4a63 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.214be29e-6d5a-456f-ab52-4c8170480f42
Nov 05 15:23:36 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:37 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-777363ec-2802-46c7-8a22-57986fe730b0 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.bc0a1533-0cd5-4db7-a557-152b8cd99b14" returned: 0 in 0.438s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-777363ec-2802-46c7-8a22-57986fe730b0 tempest-ProjectMemberTests-340429542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:23:37 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed749ba-97f2-42f8-8a4b-841bd120660d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-777363ec-2802-46c7-8a22-57986fe730b0 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:37 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f2e2d56c-abc6-4abf-92a1-d92f0a5c5534 tempest-CinderUnicodeTest-873075726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6122afb4-a242-4f30-9541-7f7feb2f4a63 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.214be29e-6d5a-456f-ab52-4c8170480f42" returned: 0 in 0.410s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:37 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-f2e2d56c-abc6-4abf-92a1-d92f0a5c5534 tempest-CinderUnicodeTest-873075726 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.214be29e-6d5a-456f-ab52-4c8170480f42 is being set with open permissions: ugo+rw
Nov 05 15:23:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f2e2d56c-abc6-4abf-92a1-d92f0a5c5534 tempest-CinderUnicodeTest-873075726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.214be29e-6d5a-456f-ab52-4c8170480f42 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:23:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:37 devstack sudo[107492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.214be29e-6d5a-456f-ab52-4c8170480f42
Nov 05 15:23:37 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:37 devstack sudo[107491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6
Nov 05 15:23:37 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:37 devstack sudo[107494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:23:37 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:37 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f2e2d56c-abc6-4abf-92a1-d92f0a5c5534 tempest-CinderUnicodeTest-873075726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.214be29e-6d5a-456f-ab52-4c8170480f42" returned: 0 in 0.363s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:37 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=221,cinder:UPDATE=316,cinder:DELETE=28,cinder:INSERT=92 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:23:37 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=246,cinder:INSERT=76,cinder:UPDATE=310,cinder:DELETE=29 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:23:37 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-777363ec-2802-46c7-8a22-57986fe730b0 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6" returned: 0 in 0.462s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-777363ec-2802-46c7-8a22-57986fe730b0 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.bc0a1533-0cd5-4db7-a557-152b8cd99b14 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f2e2d56c-abc6-4abf-92a1-d92f0a5c5534 tempest-CinderUnicodeTest-873075726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:37 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:37 devstack sudo[107502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.bc0a1533-0cd5-4db7-a557-152b8cd99b14
Nov 05 15:23:37 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.399s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:23:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:23:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 15:23:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread info: [<_MainThread(MainThread, started 136317437956224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136317326340928)>, <Thread(Thread-3 (stat_writer), started daemon 136317326487936)>, <Thread(Rabbit-heartbeat, started daemon 136317321464000)>, <Thread(Thread-5 (_runner), started daemon 136317321550592)>, <Thread(Thread-7 (_runner), started daemon 136317321658496)>, <Thread(fd_logger, started daemon 136317319612992)>, <Thread(privsep_reader, started daemon 136317319622400)>, <Thread(tpool_thread_0, started daemon 136317310928576)>, <Thread(tpool_thread_1, started daemon 136317302535872)>, <Thread(tpool_thread_2, started daemon 136317294143168)>, <Thread(tpool_thread_3, started daemon 136317285750464)>, <Thread(tpool_thread_4, started daemon 136317277357760)>, <Thread(tpool_thread_5, started daemon 136317268965056)>, <Thread(tpool_thread_6, started daemon 136317260572352)>, <Thread(tpool_thread_7, started daemon 136317252179648)>, <Thread(tpool_thread_8, started daemon 136317243786944)>, <Thread(tpool_thread_9, started daemon 136317235394240)>, <Thread(tpool_thread_10, started daemon 136317227001536)>, <Thread(tpool_thread_11, started daemon 136317218608832)>, <Thread(tpool_thread_12, started daemon 136317210216128)>, <Thread(tpool_thread_13, started daemon 136317201807040)>, <Thread(tpool_thread_14, started daemon 136317193397952)>, <Thread(tpool_thread_15, started daemon 136317184988864)>, <Thread(tpool_thread_16, started daemon 136317176579776)>, <Thread(tpool_thread_17, started daemon 136317168170688)>, <Thread(tpool_thread_18, started daemon 136317159761600)>, <Thread(tpool_thread_19, started daemon 136317151352512)>] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 15:23:37 devstack sudo[107503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.info
Nov 05 15:23:37 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:38 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f2e2d56c-abc6-4abf-92a1-d92f0a5c5534 tempest-CinderUnicodeTest-873075726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.info" returned: 0 in 0.320s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:38 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-f2e2d56c-abc6-4abf-92a1-d92f0a5c5534 tempest-CinderUnicodeTest-873075726 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.info is being set with open permissions: ugo+rw
Nov 05 15:23:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f2e2d56c-abc6-4abf-92a1-d92f0a5c5534 tempest-CinderUnicodeTest-873075726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:38 devstack sudo[107510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.info
Nov 05 15:23:38 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:38 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-777363ec-2802-46c7-8a22-57986fe730b0 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.bc0a1533-0cd5-4db7-a557-152b8cd99b14" returned: 0 in 0.392s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-777363ec-2802-46c7-8a22-57986fe730b0 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.bc0a1533-0cd5-4db7-a557-152b8cd99b14 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:38 devstack sudo[107512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.bc0a1533-0cd5-4db7-a557-152b8cd99b14
Nov 05 15:23:38 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:38 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f2e2d56c-abc6-4abf-92a1-d92f0a5c5534 tempest-CinderUnicodeTest-873075726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.info" returned: 0 in 0.259s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f2e2d56c-abc6-4abf-92a1-d92f0a5c5534 tempest-CinderUnicodeTest-873075726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.433s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:38 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-777363ec-2802-46c7-8a22-57986fe730b0 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6.bc0a1533-0cd5-4db7-a557-152b8cd99b14" returned: 0 in 0.259s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-777363ec-2802-46c7-8a22-57986fe730b0 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-bc0a1533-0cd5-4db7-a557-152b8cd99b14" released by "_delete_snapshot" :: held 1.709s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:38 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f2e2d56c-abc6-4abf-92a1-d92f0a5c5534 tempest-CinderUnicodeTest-873075726 None] Create snapshot completed successfully
Nov 05 15:23:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-777363ec-2802-46c7-8a22-57986fe730b0 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-6eb562e7-0989-403f-9b8e-777ef74bdfc6" released by "delete_snapshot" :: held 1.741s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:38 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-777363ec-2802-46c7-8a22-57986fe730b0 tempest-ProjectMemberTests-340429542 None] Created reservations ['1e6f468a-0a30-483e-b1c6-ec55134e4b9f', '89749338-917f-4ce7-9f2a-3ec1f6a4a303', '7cfdafb7-b4df-446f-b446-8fa11970adff', '6e423b3c-526e-46af-bc97-7d1defa65ea9'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:38 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-777363ec-2802-46c7-8a22-57986fe730b0 tempest-ProjectMemberTests-340429542 None] Delete snapshot completed successfully.
Nov 05 15:23:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-777363ec-2802-46c7-8a22-57986fe730b0 tempest-ProjectMemberTests-340429542 None] Lock "cinder-bc0a1533-0cd5-4db7-a557-152b8cd99b14-delete_snapshot" released by "delete_snapshot" :: held 1.938s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f191b508-aeef-41ce-a07a-d7518a2185f8 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-6eb562e7-0989-403f-9b8e-777ef74bdfc6-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f191b508-aeef-41ce-a07a-d7518a2185f8 tempest-ProjectMemberTests-340429542 None] Lock "cinder-6eb562e7-0989-403f-9b8e-777ef74bdfc6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f191b508-aeef-41ce-a07a-d7518a2185f8 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-6eb562e7-0989-403f-9b8e-777ef74bdfc6" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f191b508-aeef-41ce-a07a-d7518a2185f8 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-6eb562e7-0989-403f-9b8e-777ef74bdfc6" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:39 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0131351d-fd42-4794-8a69-189b81138f98]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f191b508-aeef-41ce-a07a-d7518a2185f8 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-75bb8993-01dc-4f49-836d-3e6d6df5d4f7 tempest-CinderUnicodeTest-873075726 None] Acquiring lock "cinder-214be29e-6d5a-456f-ab52-4c8170480f42-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-75bb8993-01dc-4f49-836d-3e6d6df5d4f7 tempest-CinderUnicodeTest-873075726 None] Lock "cinder-214be29e-6d5a-456f-ab52-4c8170480f42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-75bb8993-01dc-4f49-836d-3e6d6df5d4f7 tempest-CinderUnicodeTest-873075726 None] Acquiring lock "cinder-quobyte-6122afb4-a242-4f30-9541-7f7feb2f4a63" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-75bb8993-01dc-4f49-836d-3e6d6df5d4f7 tempest-CinderUnicodeTest-873075726 None] Lock "cinder-quobyte-6122afb4-a242-4f30-9541-7f7feb2f4a63" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-75bb8993-01dc-4f49-836d-3e6d6df5d4f7 tempest-CinderUnicodeTest-873075726 None] Acquiring lock "cinder-quobyte-214be29e-6d5a-456f-ab52-4c8170480f42" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-75bb8993-01dc-4f49-836d-3e6d6df5d4f7 tempest-CinderUnicodeTest-873075726 None] Lock "cinder-quobyte-214be29e-6d5a-456f-ab52-4c8170480f42" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-75bb8993-01dc-4f49-836d-3e6d6df5d4f7 tempest-CinderUnicodeTest-873075726 None] Deleting offline snapshot 214be29e-6d5a-456f-ab52-4c8170480f42 of volume 6122afb4-a242-4f30-9541-7f7feb2f4a63 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:23:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-75bb8993-01dc-4f49-836d-3e6d6df5d4f7 tempest-CinderUnicodeTest-873075726 None] snapshot_file for this snap is: volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.214be29e-6d5a-456f-ab52-4c8170480f42 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:23:39 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[418588ab-4ddd-4e6b-962a-907a4154e6c4]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-75bb8993-01dc-4f49-836d-3e6d6df5d4f7 tempest-CinderUnicodeTest-873075726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.214be29e-6d5a-456f-ab52-4c8170480f42 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:39 devstack sudo[107516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6
Nov 05 15:23:39 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:39 devstack sudo[107519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.214be29e-6d5a-456f-ab52-4c8170480f42
Nov 05 15:23:39 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:39 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f191b508-aeef-41ce-a07a-d7518a2185f8 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6" returned: 0 in 0.662s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f191b508-aeef-41ce-a07a-d7518a2185f8 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:39 devstack sudo[107526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6
Nov 05 15:23:39 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:40 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-75bb8993-01dc-4f49-836d-3e6d6df5d4f7 tempest-CinderUnicodeTest-873075726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.214be29e-6d5a-456f-ab52-4c8170480f42" returned: 0 in 0.608s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-75bb8993-01dc-4f49-836d-3e6d6df5d4f7 tempest-CinderUnicodeTest-873075726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6122afb4-a242-4f30-9541-7f7feb2f4a63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:23:40 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60cf897-e062-406d-a2da-8c3beca43ff6]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-75bb8993-01dc-4f49-836d-3e6d6df5d4f7 tempest-CinderUnicodeTest-873075726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:40 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f191b508-aeef-41ce-a07a-d7518a2185f8 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6eb562e7-0989-403f-9b8e-777ef74bdfc6" returned: 0 in 0.298s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:40 devstack sudo[107532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63
Nov 05 15:23:40 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f191b508-aeef-41ce-a07a-d7518a2185f8 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-6eb562e7-0989-403f-9b8e-777ef74bdfc6" released by "delete_volume" :: held 1.069s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:40 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-f191b508-aeef-41ce-a07a-d7518a2185f8 tempest-ProjectMemberTests-340429542 None] Created reservations ['ea38e494-9cb5-4a8a-8a22-d13954c03d14', 'f1af563b-5172-4342-9e42-4b7d88283709', '82456626-e238-47d9-8ff6-04fed37685df', 'cb652f01-9f5a-4856-a3bb-0f27998b24dd'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f191b508-aeef-41ce-a07a-d7518a2185f8 tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f191b508-aeef-41ce-a07a-d7518a2185f8 tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f191b508-aeef-41ce-a07a-d7518a2185f8 tempest-ProjectMemberTests-340429542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f191b508-aeef-41ce-a07a-d7518a2185f8 tempest-ProjectMemberTests-340429542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f191b508-aeef-41ce-a07a-d7518a2185f8 tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f191b508-aeef-41ce-a07a-d7518a2185f8 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:40 devstack sudo[107535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:23:40 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:40 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-75bb8993-01dc-4f49-836d-3e6d6df5d4f7 tempest-CinderUnicodeTest-873075726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63" returned: 0 in 0.408s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-75bb8993-01dc-4f49-836d-3e6d6df5d4f7 tempest-CinderUnicodeTest-873075726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.214be29e-6d5a-456f-ab52-4c8170480f42 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:40 devstack sudo[107540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.214be29e-6d5a-456f-ab52-4c8170480f42
Nov 05 15:23:40 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:40 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f191b508-aeef-41ce-a07a-d7518a2185f8 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.282s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:40 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-f191b508-aeef-41ce-a07a-d7518a2185f8 tempest-ProjectMemberTests-340429542 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:23:40 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f191b508-aeef-41ce-a07a-d7518a2185f8 tempest-ProjectMemberTests-340429542 None] Deleted volume successfully.
Nov 05 15:23:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f191b508-aeef-41ce-a07a-d7518a2185f8 tempest-ProjectMemberTests-340429542 None] Lock "cinder-6eb562e7-0989-403f-9b8e-777ef74bdfc6-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:40 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-75bb8993-01dc-4f49-836d-3e6d6df5d4f7 tempest-CinderUnicodeTest-873075726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.214be29e-6d5a-456f-ab52-4c8170480f42" returned: 0 in 0.405s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-75bb8993-01dc-4f49-836d-3e6d6df5d4f7 tempest-CinderUnicodeTest-873075726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.214be29e-6d5a-456f-ab52-4c8170480f42 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:40 devstack sudo[107546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.214be29e-6d5a-456f-ab52-4c8170480f42
Nov 05 15:23:40 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:41 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-75bb8993-01dc-4f49-836d-3e6d6df5d4f7 tempest-CinderUnicodeTest-873075726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63.214be29e-6d5a-456f-ab52-4c8170480f42" returned: 0 in 0.284s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-75bb8993-01dc-4f49-836d-3e6d6df5d4f7 tempest-CinderUnicodeTest-873075726 None] Lock "cinder-quobyte-214be29e-6d5a-456f-ab52-4c8170480f42" released by "_delete_snapshot" :: held 1.885s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-75bb8993-01dc-4f49-836d-3e6d6df5d4f7 tempest-CinderUnicodeTest-873075726 None] Lock "cinder-quobyte-6122afb4-a242-4f30-9541-7f7feb2f4a63" released by "delete_snapshot" :: held 1.910s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:41 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-75bb8993-01dc-4f49-836d-3e6d6df5d4f7 tempest-CinderUnicodeTest-873075726 None] Created reservations ['8fffb1c1-ce20-4486-b2cd-b06746148b40', 'aee00f8e-3534-44f5-9793-8abc9d9b1a7c', '6751054a-d92d-4321-868c-da9c5399fc63', 'ffb827fc-7229-443a-a511-e4f093c169d2'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:41 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-75bb8993-01dc-4f49-836d-3e6d6df5d4f7 tempest-CinderUnicodeTest-873075726 None] Delete snapshot completed successfully.
Nov 05 15:23:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-75bb8993-01dc-4f49-836d-3e6d6df5d4f7 tempest-CinderUnicodeTest-873075726 None] Lock "cinder-214be29e-6d5a-456f-ab52-4c8170480f42-delete_snapshot" released by "delete_snapshot" :: held 2.100s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ac5ae6df-06de-4ef5-b0e5-2c3b2d02bc5b tempest-CinderUnicodeTest-873075726 None] Acquiring lock "cinder-6122afb4-a242-4f30-9541-7f7feb2f4a63-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ac5ae6df-06de-4ef5-b0e5-2c3b2d02bc5b tempest-CinderUnicodeTest-873075726 None] Lock "cinder-6122afb4-a242-4f30-9541-7f7feb2f4a63-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ac5ae6df-06de-4ef5-b0e5-2c3b2d02bc5b tempest-CinderUnicodeTest-873075726 None] Acquiring lock "cinder-quobyte-6122afb4-a242-4f30-9541-7f7feb2f4a63" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ac5ae6df-06de-4ef5-b0e5-2c3b2d02bc5b tempest-CinderUnicodeTest-873075726 None] Lock "cinder-quobyte-6122afb4-a242-4f30-9541-7f7feb2f4a63" acquired by "delete_volume" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:41 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e3a602-0e42-4298-9a92-555853a4616e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ac5ae6df-06de-4ef5-b0e5-2c3b2d02bc5b tempest-CinderUnicodeTest-873075726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Flow 'volume_create_manager' (fa7aee5c-00f6-44f2-8531-22a551a0dee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c4baed-91ff-445e-bfe7-da8de8fc9aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:42 devstack sudo[107549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63
Nov 05 15:23:42 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c4baed-91ff-445e-bfe7-da8de8fc9aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1276219239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b7990b-6bd3-4499-a91d-cc92b25d4117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9e03f4a164bf48042da27edfd742d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:42Z,use_quota=True,user_id='d3585054b64542a1a174061b1731d371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18021454-7fd8-42a6-a538-a2ef3e137aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18021454-7fd8-42a6-a538-a2ef3e137aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f51000-630c-45e3-897f-4802a0b0ef3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f51000-630c-45e3-897f-4802a0b0ef3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45b7990b-6bd3-4499-a91d-cc92b25d4117', 'volume_name': 'volume-45b7990b-6bd3-4499-a91d-cc92b25d4117', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3240689d-06b4-4e3b-9aaa-a7333ced975b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3240689d-06b4-4e3b-9aaa-a7333ced975b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f22520e-da0b-4a93-b778-7c70f722ad93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:42 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Volume 45b7990b-6bd3-4499-a91d-cc92b25d4117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45b7990b-6bd3-4499-a91d-cc92b25d4117', 'volume_size': 1}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1276219239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b7990b-6bd3-4499-a91d-cc92b25d4117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9e03f4a164bf48042da27edfd742d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:42Z,use_quota=True,user_id='d3585054b64542a1a174061b1731d371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Creating volume 45b7990b-6bd3-4499-a91d-cc92b25d4117 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:23:42 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:42 devstack sudo[107551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117 1073741824
Nov 05 15:23:42 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:42 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ac5ae6df-06de-4ef5-b0e5-2c3b2d02bc5b tempest-CinderUnicodeTest-873075726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63" returned: 0 in 0.456s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ac5ae6df-06de-4ef5-b0e5-2c3b2d02bc5b tempest-CinderUnicodeTest-873075726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:42 devstack sudo[107558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63
Nov 05 15:23:42 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:42 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117 1073741824" returned: 0 in 0.459s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:42 devstack sudo[107563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117
Nov 05 15:23:42 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:42 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ac5ae6df-06de-4ef5-b0e5-2c3b2d02bc5b tempest-CinderUnicodeTest-873075726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6122afb4-a242-4f30-9541-7f7feb2f4a63" returned: 0 in 0.268s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ac5ae6df-06de-4ef5-b0e5-2c3b2d02bc5b tempest-CinderUnicodeTest-873075726 None] Lock "cinder-quobyte-6122afb4-a242-4f30-9541-7f7feb2f4a63" released by "delete_volume" :: held 0.805s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-ac5ae6df-06de-4ef5-b0e5-2c3b2d02bc5b tempest-CinderUnicodeTest-873075726 None] Created reservations ['7c0a9382-0fc4-4d08-b168-d0402b9242b8', '40f5efce-2420-42a5-99d2-8253d9b59504', 'b5e53f5d-c99b-4c2b-9c79-2729d951dbf8', 'bd5f43ad-82ea-4772-bff2-487e2ec2e931'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ac5ae6df-06de-4ef5-b0e5-2c3b2d02bc5b tempest-CinderUnicodeTest-873075726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ac5ae6df-06de-4ef5-b0e5-2c3b2d02bc5b tempest-CinderUnicodeTest-873075726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ac5ae6df-06de-4ef5-b0e5-2c3b2d02bc5b tempest-CinderUnicodeTest-873075726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ac5ae6df-06de-4ef5-b0e5-2c3b2d02bc5b tempest-CinderUnicodeTest-873075726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ac5ae6df-06de-4ef5-b0e5-2c3b2d02bc5b tempest-CinderUnicodeTest-873075726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ac5ae6df-06de-4ef5-b0e5-2c3b2d02bc5b tempest-CinderUnicodeTest-873075726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:42 devstack sudo[107565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:23:42 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:42 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117" returned: 0 in 0.288s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f22520e-da0b-4a93-b778-7c70f722ad93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45b7990b-6bd3-4499-a91d-cc92b25d4117', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9c97be-9945-43ca-b9b9-a1376f6f5c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bef2e003-b513-477b-8ec0-f82ee788c981 tempest-CinderUnicodeTest-873075726 None] Acquiring lock "cinder-5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:43 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Volume volume-45b7990b-6bd3-4499-a91d-cc92b25d4117 (45b7990b-6bd3-4499-a91d-cc92b25d4117): created successfully
Nov 05 15:23:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9c97be-9945-43ca-b9b9-a1376f6f5c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Flow 'volume_create_manager' (fa7aee5c-00f6-44f2-8531-22a551a0dee3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:43 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7484d6ea-0143-469e-aec9-cb2b468933af tempest-ProjectMemberTests-340429542 None] Created volume successfully.
Nov 05 15:23:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bef2e003-b513-477b-8ec0-f82ee788c981 tempest-CinderUnicodeTest-873075726 None] Lock "cinder-5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bef2e003-b513-477b-8ec0-f82ee788c981 tempest-CinderUnicodeTest-873075726 None] Acquiring lock "cinder-quobyte-5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bef2e003-b513-477b-8ec0-f82ee788c981 tempest-CinderUnicodeTest-873075726 None] Lock "cinder-quobyte-5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:43 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ac5ae6df-06de-4ef5-b0e5-2c3b2d02bc5b tempest-CinderUnicodeTest-873075726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.290s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:43 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-ac5ae6df-06de-4ef5-b0e5-2c3b2d02bc5b tempest-CinderUnicodeTest-873075726 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:23:43 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ac5ae6df-06de-4ef5-b0e5-2c3b2d02bc5b tempest-CinderUnicodeTest-873075726 None] Deleted volume successfully.
Nov 05 15:23:43 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6949ec-c007-453b-8e13-e639b84ad2ac]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bef2e003-b513-477b-8ec0-f82ee788c981 tempest-CinderUnicodeTest-873075726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ac5ae6df-06de-4ef5-b0e5-2c3b2d02bc5b tempest-CinderUnicodeTest-873075726 None] Lock "cinder-6122afb4-a242-4f30-9541-7f7feb2f4a63-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:43 devstack sudo[107569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a
Nov 05 15:23:43 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:43 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bef2e003-b513-477b-8ec0-f82ee788c981 tempest-CinderUnicodeTest-873075726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a" returned: 0 in 0.388s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bef2e003-b513-477b-8ec0-f82ee788c981 tempest-CinderUnicodeTest-873075726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:43 devstack sudo[107574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a
Nov 05 15:23:43 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:43 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bef2e003-b513-477b-8ec0-f82ee788c981 tempest-CinderUnicodeTest-873075726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a" returned: 0 in 0.289s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bef2e003-b513-477b-8ec0-f82ee788c981 tempest-CinderUnicodeTest-873075726 None] Lock "cinder-quobyte-5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a" released by "delete_volume" :: held 0.750s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:44 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-bef2e003-b513-477b-8ec0-f82ee788c981 tempest-CinderUnicodeTest-873075726 None] Created reservations ['6ad208ad-5155-4797-8a54-d0a01076b1b2', '13e967c1-c50a-4f5e-9294-4951b0485eb4', '17bfb38e-301b-403b-9b21-cc5d98360376', 'e364f335-d54d-4c87-be6d-e84ff746a986'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bef2e003-b513-477b-8ec0-f82ee788c981 tempest-CinderUnicodeTest-873075726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bef2e003-b513-477b-8ec0-f82ee788c981 tempest-CinderUnicodeTest-873075726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bef2e003-b513-477b-8ec0-f82ee788c981 tempest-CinderUnicodeTest-873075726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bef2e003-b513-477b-8ec0-f82ee788c981 tempest-CinderUnicodeTest-873075726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bef2e003-b513-477b-8ec0-f82ee788c981 tempest-CinderUnicodeTest-873075726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bef2e003-b513-477b-8ec0-f82ee788c981 tempest-CinderUnicodeTest-873075726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:44 devstack sudo[107577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:23:44 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-be875e9e-880b-4f0e-8eb0-16db7efbdc05 tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-be875e9e-880b-4f0e-8eb0-16db7efbdc05 tempest-ProjectMemberTests-340429542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-be875e9e-880b-4f0e-8eb0-16db7efbdc05 tempest-ProjectMemberTests-340429542 None] Creating offline snapshot 75464bce-cbbe-4780-bbe5-7086d24c37da of volume 45b7990b-6bd3-4499-a91d-cc92b25d4117 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:23:44 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e49296-a88f-4b9d-a567-b982f6fd2529]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-be875e9e-880b-4f0e-8eb0-16db7efbdc05 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:44 devstack sudo[107579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117
Nov 05 15:23:44 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:44 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bef2e003-b513-477b-8ec0-f82ee788c981 tempest-CinderUnicodeTest-873075726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.459s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:44 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-bef2e003-b513-477b-8ec0-f82ee788c981 tempest-CinderUnicodeTest-873075726 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:23:44 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-bef2e003-b513-477b-8ec0-f82ee788c981 tempest-CinderUnicodeTest-873075726 None] Deleted volume successfully.
Nov 05 15:23:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bef2e003-b513-477b-8ec0-f82ee788c981 tempest-CinderUnicodeTest-873075726 None] Lock "cinder-5be3b6a8-2590-4b48-8f57-f0c7a6e8cb5a-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:44 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-be875e9e-880b-4f0e-8eb0-16db7efbdc05 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117" returned: 0 in 0.561s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-be875e9e-880b-4f0e-8eb0-16db7efbdc05 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.75464bce-cbbe-4780-bbe5-7086d24c37da 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:44 devstack sudo[107585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.75464bce-cbbe-4780-bbe5-7086d24c37da 1G
Nov 05 15:23:44 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:45 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-be875e9e-880b-4f0e-8eb0-16db7efbdc05 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.75464bce-cbbe-4780-bbe5-7086d24c37da 1G" returned: 0 in 0.505s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-be875e9e-880b-4f0e-8eb0-16db7efbdc05 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b7990b-6bd3-4499-a91d-cc92b25d4117 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.75464bce-cbbe-4780-bbe5-7086d24c37da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:45 devstack sudo[107591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b7990b-6bd3-4499-a91d-cc92b25d4117 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.75464bce-cbbe-4780-bbe5-7086d24c37da
Nov 05 15:23:45 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:45 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-be875e9e-880b-4f0e-8eb0-16db7efbdc05 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b7990b-6bd3-4499-a91d-cc92b25d4117 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.75464bce-cbbe-4780-bbe5-7086d24c37da" returned: 0 in 0.367s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:45 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-be875e9e-880b-4f0e-8eb0-16db7efbdc05 tempest-ProjectMemberTests-340429542 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.75464bce-cbbe-4780-bbe5-7086d24c37da is being set with open permissions: ugo+rw
Nov 05 15:23:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-be875e9e-880b-4f0e-8eb0-16db7efbdc05 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.75464bce-cbbe-4780-bbe5-7086d24c37da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:45 devstack sudo[107596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.75464bce-cbbe-4780-bbe5-7086d24c37da
Nov 05 15:23:45 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:46 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-be875e9e-880b-4f0e-8eb0-16db7efbdc05 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.75464bce-cbbe-4780-bbe5-7086d24c37da" returned: 0 in 0.282s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-be875e9e-880b-4f0e-8eb0-16db7efbdc05 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:46 devstack sudo[107599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.info
Nov 05 15:23:46 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:46 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-be875e9e-880b-4f0e-8eb0-16db7efbdc05 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.info" returned: 0 in 0.299s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:46 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-be875e9e-880b-4f0e-8eb0-16db7efbdc05 tempest-ProjectMemberTests-340429542 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.info is being set with open permissions: ugo+rw
Nov 05 15:23:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-be875e9e-880b-4f0e-8eb0-16db7efbdc05 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:46 devstack sudo[107602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.info
Nov 05 15:23:46 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:46 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-be875e9e-880b-4f0e-8eb0-16db7efbdc05 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.info" returned: 0 in 0.273s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-be875e9e-880b-4f0e-8eb0-16db7efbdc05 tempest-ProjectMemberTests-340429542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.400s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:46 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-be875e9e-880b-4f0e-8eb0-16db7efbdc05 tempest-ProjectMemberTests-340429542 None] Create snapshot completed successfully
Nov 05 15:23:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c242741c-0259-4bbc-a483-5d71c78aa5d7 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-75464bce-cbbe-4780-bbe5-7086d24c37da-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c242741c-0259-4bbc-a483-5d71c78aa5d7 tempest-ProjectMemberTests-340429542 None] Lock "cinder-75464bce-cbbe-4780-bbe5-7086d24c37da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c242741c-0259-4bbc-a483-5d71c78aa5d7 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-45b7990b-6bd3-4499-a91d-cc92b25d4117" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c242741c-0259-4bbc-a483-5d71c78aa5d7 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-45b7990b-6bd3-4499-a91d-cc92b25d4117" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c242741c-0259-4bbc-a483-5d71c78aa5d7 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-75464bce-cbbe-4780-bbe5-7086d24c37da" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c242741c-0259-4bbc-a483-5d71c78aa5d7 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-75464bce-cbbe-4780-bbe5-7086d24c37da" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c242741c-0259-4bbc-a483-5d71c78aa5d7 tempest-ProjectMemberTests-340429542 None] Deleting offline snapshot 75464bce-cbbe-4780-bbe5-7086d24c37da of volume 45b7990b-6bd3-4499-a91d-cc92b25d4117 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:23:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c242741c-0259-4bbc-a483-5d71c78aa5d7 tempest-ProjectMemberTests-340429542 None] snapshot_file for this snap is: volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.75464bce-cbbe-4780-bbe5-7086d24c37da {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:23:47 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d3508b-63b3-49d5-918c-526c75cba36f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c242741c-0259-4bbc-a483-5d71c78aa5d7 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.75464bce-cbbe-4780-bbe5-7086d24c37da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:47 devstack sudo[107605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.75464bce-cbbe-4780-bbe5-7086d24c37da
Nov 05 15:23:47 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:48 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c242741c-0259-4bbc-a483-5d71c78aa5d7 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.75464bce-cbbe-4780-bbe5-7086d24c37da" returned: 0 in 0.491s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c242741c-0259-4bbc-a483-5d71c78aa5d7 tempest-ProjectMemberTests-340429542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45b7990b-6bd3-4499-a91d-cc92b25d4117(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:23:48 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad6ca6d-fc10-4b5b-844d-3bba77b3e890]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c242741c-0259-4bbc-a483-5d71c78aa5d7 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:48 devstack sudo[107610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117
Nov 05 15:23:48 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3e57b1b7-cbd5-4178-86de-caaceba200b6 tempest-ProjectAdminTests-1971060071 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4655227661133, 'free_capacity_gb': 1773.4655227661133, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87150) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 05 15:23:48 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c242741c-0259-4bbc-a483-5d71c78aa5d7 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117" returned: 0 in 0.463s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c242741c-0259-4bbc-a483-5d71c78aa5d7 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.75464bce-cbbe-4780-bbe5-7086d24c37da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:48 devstack sudo[107615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.75464bce-cbbe-4780-bbe5-7086d24c37da
Nov 05 15:23:48 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:49 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c242741c-0259-4bbc-a483-5d71c78aa5d7 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.75464bce-cbbe-4780-bbe5-7086d24c37da" returned: 0 in 0.432s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c242741c-0259-4bbc-a483-5d71c78aa5d7 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.75464bce-cbbe-4780-bbe5-7086d24c37da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:49 devstack sudo[107620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.75464bce-cbbe-4780-bbe5-7086d24c37da
Nov 05 15:23:49 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:49 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c242741c-0259-4bbc-a483-5d71c78aa5d7 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117.75464bce-cbbe-4780-bbe5-7086d24c37da" returned: 0 in 0.296s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c242741c-0259-4bbc-a483-5d71c78aa5d7 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-75464bce-cbbe-4780-bbe5-7086d24c37da" released by "_delete_snapshot" :: held 1.842s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c242741c-0259-4bbc-a483-5d71c78aa5d7 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-45b7990b-6bd3-4499-a91d-cc92b25d4117" released by "delete_snapshot" :: held 1.886s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:49 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-c242741c-0259-4bbc-a483-5d71c78aa5d7 tempest-ProjectMemberTests-340429542 None] Created reservations ['8e87c8e0-85a3-4896-b8be-81e5c67e70b7', '5b9ba8b8-a31a-413e-a55a-cd3106725504', 'd3e1dddc-4a92-4233-970e-12181a3b3814', 'a136c4af-c4d3-428f-a9fa-12dddc7bbcac'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:49 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c242741c-0259-4bbc-a483-5d71c78aa5d7 tempest-ProjectMemberTests-340429542 None] Delete snapshot completed successfully.
Nov 05 15:23:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c242741c-0259-4bbc-a483-5d71c78aa5d7 tempest-ProjectMemberTests-340429542 None] Lock "cinder-75464bce-cbbe-4780-bbe5-7086d24c37da-delete_snapshot" released by "delete_snapshot" :: held 2.090s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b3c77979-7fb7-44f1-9821-b227b2ae1e93 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-45b7990b-6bd3-4499-a91d-cc92b25d4117-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b3c77979-7fb7-44f1-9821-b227b2ae1e93 tempest-ProjectMemberTests-340429542 None] Lock "cinder-45b7990b-6bd3-4499-a91d-cc92b25d4117-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b3c77979-7fb7-44f1-9821-b227b2ae1e93 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-45b7990b-6bd3-4499-a91d-cc92b25d4117" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b3c77979-7fb7-44f1-9821-b227b2ae1e93 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-45b7990b-6bd3-4499-a91d-cc92b25d4117" acquired by "delete_volume" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:50 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1d5323-4686-49ed-b617-b207ee6ed23c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3c77979-7fb7-44f1-9821-b227b2ae1e93 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:50 devstack sudo[107624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117
Nov 05 15:23:50 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:50 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3c77979-7fb7-44f1-9821-b227b2ae1e93 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117" returned: 0 in 0.542s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3c77979-7fb7-44f1-9821-b227b2ae1e93 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:50 devstack sudo[107630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117
Nov 05 15:23:50 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:50 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3c77979-7fb7-44f1-9821-b227b2ae1e93 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-45b7990b-6bd3-4499-a91d-cc92b25d4117" returned: 0 in 0.323s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b3c77979-7fb7-44f1-9821-b227b2ae1e93 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-45b7990b-6bd3-4499-a91d-cc92b25d4117" released by "delete_volume" :: held 0.947s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:50 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b3c77979-7fb7-44f1-9821-b227b2ae1e93 tempest-ProjectMemberTests-340429542 None] Created reservations ['f49532c8-3643-4061-b8d6-ed6cb9d01f79', '47a1906c-f856-4a9b-b099-8c6472c51291', 'b4124864-7f9e-44d0-a1f9-6af553968abd', 'b5e971a1-a161-4e9c-997b-6922fc3ee860'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b3c77979-7fb7-44f1-9821-b227b2ae1e93 tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b3c77979-7fb7-44f1-9821-b227b2ae1e93 tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b3c77979-7fb7-44f1-9821-b227b2ae1e93 tempest-ProjectMemberTests-340429542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b3c77979-7fb7-44f1-9821-b227b2ae1e93 tempest-ProjectMemberTests-340429542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b3c77979-7fb7-44f1-9821-b227b2ae1e93 tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3c77979-7fb7-44f1-9821-b227b2ae1e93 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:51 devstack sudo[107633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:23:51 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:51 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3c77979-7fb7-44f1-9821-b227b2ae1e93 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.307s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-b3c77979-7fb7-44f1-9821-b227b2ae1e93 tempest-ProjectMemberTests-340429542 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:23:51 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b3c77979-7fb7-44f1-9821-b227b2ae1e93 tempest-ProjectMemberTests-340429542 None] Deleted volume successfully.
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b3c77979-7fb7-44f1-9821-b227b2ae1e93 tempest-ProjectMemberTests-340429542 None] Lock "cinder-45b7990b-6bd3-4499-a91d-cc92b25d4117-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Flow 'volume_create_manager' (5e34bfd3-b01f-48a6-a94c-1984df9908dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a8197e-b513-46ad-93f5-97e83a17c277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a8197e-b513-46ad-93f5-97e83a17c277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1157264468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df2610c-7b0c-4803-b561-007685bcfc9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9e03f4a164bf48042da27edfd742d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:52Z,use_quota=True,user_id='d3585054b64542a1a174061b1731d371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a581e3-b4f3-4311-9807-3fbd0fa49b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a581e3-b4f3-4311-9807-3fbd0fa49b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d59e2eb-1999-40ab-a1a8-c92b00bba831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d59e2eb-1999-40ab-a1a8-c92b00bba831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4df2610c-7b0c-4803-b561-007685bcfc9b', 'volume_name': 'volume-4df2610c-7b0c-4803-b561-007685bcfc9b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6419cd1c-432b-4a54-ac0a-ab61765a31a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6419cd1c-432b-4a54-ac0a-ab61765a31a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa872cf-d2e0-4f12-9a61-53c00cb5ecc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:51 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Volume 4df2610c-7b0c-4803-b561-007685bcfc9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4df2610c-7b0c-4803-b561-007685bcfc9b', 'volume_size': 1}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1157264468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df2610c-7b0c-4803-b561-007685bcfc9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9e03f4a164bf48042da27edfd742d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:52Z,use_quota=True,user_id='d3585054b64542a1a174061b1731d371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Creating volume 4df2610c-7b0c-4803-b561-007685bcfc9b {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:23:51 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:23:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:23:52 devstack sudo[107636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b 1073741824
Nov 05 15:23:52 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Flow 'volume_create_manager' (ec00e088-bad1-4ce6-8eac-9bd5d57db04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aedc4fae-768a-40fe-89d0-2b81f1159f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aedc4fae-768a-40fe-89d0-2b81f1159f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-72382504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488d256c-5c7f-4811-a8da-84b4acae53a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7ff19a4fa44c489ecbe962d28938fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:52Z,use_quota=True,user_id='b13a9949463546bdba17ff98346fe5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5554c3ae-7a4b-4ea6-9ef5-52dcba1275c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5554c3ae-7a4b-4ea6-9ef5-52dcba1275c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecadb67a-61f1-4331-b637-0d86e9c0bd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecadb67a-61f1-4331-b637-0d86e9c0bd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '488d256c-5c7f-4811-a8da-84b4acae53a0', 'volume_name': 'volume-488d256c-5c7f-4811-a8da-84b4acae53a0', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf48ef05-497a-441e-adb0-acddec7c809f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf48ef05-497a-441e-adb0-acddec7c809f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (802bc905-9380-49f1-af56-54835a2990e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:52 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Volume 488d256c-5c7f-4811-a8da-84b4acae53a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-488d256c-5c7f-4811-a8da-84b4acae53a0', 'volume_size': 1}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:52 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b 1073741824" returned: 0 in 0.539s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:52 devstack sudo[107642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b
Nov 05 15:23:52 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:52 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b" returned: 0 in 0.318s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.776s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-72382504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488d256c-5c7f-4811-a8da-84b4acae53a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7ff19a4fa44c489ecbe962d28938fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:52Z,use_quota=True,user_id='b13a9949463546bdba17ff98346fe5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Creating volume 488d256c-5c7f-4811-a8da-84b4acae53a0 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:23:52 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-488d256c-5c7f-4811-a8da-84b4acae53a0 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa872cf-d2e0-4f12-9a61-53c00cb5ecc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4df2610c-7b0c-4803-b561-007685bcfc9b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a705614-b21e-46bd-a096-b82ef922cdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:52 devstack sudo[107645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-488d256c-5c7f-4811-a8da-84b4acae53a0 1073741824
Nov 05 15:23:52 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:52 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Volume volume-4df2610c-7b0c-4803-b561-007685bcfc9b (4df2610c-7b0c-4803-b561-007685bcfc9b): created successfully
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a705614-b21e-46bd-a096-b82ef922cdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Flow 'volume_create_manager' (5e34bfd3-b01f-48a6-a94c-1984df9908dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:52 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3ddee5b4-3c6b-4739-9192-0c9fb56f6b4c tempest-ProjectMemberTests-340429542 None] Created volume successfully.
Nov 05 15:23:53 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-488d256c-5c7f-4811-a8da-84b4acae53a0 1073741824" returned: 0 in 0.449s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-488d256c-5c7f-4811-a8da-84b4acae53a0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:53 devstack sudo[107650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-488d256c-5c7f-4811-a8da-84b4acae53a0
Nov 05 15:23:53 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:53 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-488d256c-5c7f-4811-a8da-84b4acae53a0" returned: 0 in 0.261s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:23:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (802bc905-9380-49f1-af56-54835a2990e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-488d256c-5c7f-4811-a8da-84b4acae53a0', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2187e111-3747-461b-9029-dbaca4058e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:53 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Volume volume-488d256c-5c7f-4811-a8da-84b4acae53a0 (488d256c-5c7f-4811-a8da-84b4acae53a0): created successfully
Nov 05 15:23:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2187e111-3747-461b-9029-dbaca4058e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Flow 'volume_create_manager' (ec00e088-bad1-4ce6-8eac-9bd5d57db04b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:53 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d962d8f1-3fde-4876-925f-d9e9d1fb4ffe tempest-ProjectReaderTests-1781691025 None] Created volume successfully.
Nov 05 15:23:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3283acf2-8f77-4dc6-a710-ed170e758025 tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3283acf2-8f77-4dc6-a710-ed170e758025 tempest-ProjectMemberTests-340429542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-3283acf2-8f77-4dc6-a710-ed170e758025 tempest-ProjectMemberTests-340429542 None] Creating offline snapshot ed838cae-324c-4ff9-9431-32d268b8e9c6 of volume 4df2610c-7b0c-4803-b561-007685bcfc9b {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:23:54 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8eb93b-97f4-4362-9401-e0b0d7ab2dd1]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3283acf2-8f77-4dc6-a710-ed170e758025 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:54 devstack sudo[107653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b
Nov 05 15:23:54 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dcf55bed-0160-433c-8969-c114f06ed637 tempest-ProjectReaderTests-1781691025 None] Acquiring lock "cinder-488d256c-5c7f-4811-a8da-84b4acae53a0-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dcf55bed-0160-433c-8969-c114f06ed637 tempest-ProjectReaderTests-1781691025 None] Lock "cinder-488d256c-5c7f-4811-a8da-84b4acae53a0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dcf55bed-0160-433c-8969-c114f06ed637 tempest-ProjectReaderTests-1781691025 None] Acquiring lock "cinder-quobyte-488d256c-5c7f-4811-a8da-84b4acae53a0" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dcf55bed-0160-433c-8969-c114f06ed637 tempest-ProjectReaderTests-1781691025 None] Lock "cinder-quobyte-488d256c-5c7f-4811-a8da-84b4acae53a0" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:54 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2d7e2b-466b-4115-90eb-d9fd22850612]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dcf55bed-0160-433c-8969-c114f06ed637 tempest-ProjectReaderTests-1781691025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-488d256c-5c7f-4811-a8da-84b4acae53a0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:54 devstack sudo[107655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-488d256c-5c7f-4811-a8da-84b4acae53a0
Nov 05 15:23:54 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:54 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3283acf2-8f77-4dc6-a710-ed170e758025 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b" returned: 0 in 0.495s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3283acf2-8f77-4dc6-a710-ed170e758025 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.ed838cae-324c-4ff9-9431-32d268b8e9c6 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:54 devstack sudo[107660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.ed838cae-324c-4ff9-9431-32d268b8e9c6 1G
Nov 05 15:23:54 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:54 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dcf55bed-0160-433c-8969-c114f06ed637 tempest-ProjectReaderTests-1781691025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-488d256c-5c7f-4811-a8da-84b4acae53a0" returned: 0 in 0.439s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dcf55bed-0160-433c-8969-c114f06ed637 tempest-ProjectReaderTests-1781691025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-488d256c-5c7f-4811-a8da-84b4acae53a0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:54 devstack sudo[107666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-488d256c-5c7f-4811-a8da-84b4acae53a0
Nov 05 15:23:54 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:55 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3283acf2-8f77-4dc6-a710-ed170e758025 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.ed838cae-324c-4ff9-9431-32d268b8e9c6 1G" returned: 0 in 0.629s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3283acf2-8f77-4dc6-a710-ed170e758025 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4df2610c-7b0c-4803-b561-007685bcfc9b -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.ed838cae-324c-4ff9-9431-32d268b8e9c6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:55 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dcf55bed-0160-433c-8969-c114f06ed637 tempest-ProjectReaderTests-1781691025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-488d256c-5c7f-4811-a8da-84b4acae53a0" returned: 0 in 0.391s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:55 devstack sudo[107674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4df2610c-7b0c-4803-b561-007685bcfc9b -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.ed838cae-324c-4ff9-9431-32d268b8e9c6
Nov 05 15:23:55 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dcf55bed-0160-433c-8969-c114f06ed637 tempest-ProjectReaderTests-1781691025 None] Lock "cinder-quobyte-488d256c-5c7f-4811-a8da-84b4acae53a0" released by "delete_volume" :: held 0.896s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:55 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-dcf55bed-0160-433c-8969-c114f06ed637 tempest-ProjectReaderTests-1781691025 None] Created reservations ['10d58053-9208-455d-95e3-0774ec87ccbd', '7fffcd1e-88f2-4ad2-b871-ba260dc21e34', 'f0c0a4ff-3a96-4912-ad85-35198d662e11', 'b2cf9e78-1b55-471b-a61b-7a3eef9c3dd2'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dcf55bed-0160-433c-8969-c114f06ed637 tempest-ProjectReaderTests-1781691025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dcf55bed-0160-433c-8969-c114f06ed637 tempest-ProjectReaderTests-1781691025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dcf55bed-0160-433c-8969-c114f06ed637 tempest-ProjectReaderTests-1781691025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dcf55bed-0160-433c-8969-c114f06ed637 tempest-ProjectReaderTests-1781691025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dcf55bed-0160-433c-8969-c114f06ed637 tempest-ProjectReaderTests-1781691025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dcf55bed-0160-433c-8969-c114f06ed637 tempest-ProjectReaderTests-1781691025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:55 devstack sudo[107677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:23:55 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:55 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3283acf2-8f77-4dc6-a710-ed170e758025 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4df2610c-7b0c-4803-b561-007685bcfc9b -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.ed838cae-324c-4ff9-9431-32d268b8e9c6" returned: 0 in 0.418s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:55 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-3283acf2-8f77-4dc6-a710-ed170e758025 tempest-ProjectMemberTests-340429542 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.ed838cae-324c-4ff9-9431-32d268b8e9c6 is being set with open permissions: ugo+rw
Nov 05 15:23:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3283acf2-8f77-4dc6-a710-ed170e758025 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.ed838cae-324c-4ff9-9431-32d268b8e9c6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:55 devstack sudo[107681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.ed838cae-324c-4ff9-9431-32d268b8e9c6
Nov 05 15:23:55 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:55 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dcf55bed-0160-433c-8969-c114f06ed637 tempest-ProjectReaderTests-1781691025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.422s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:55 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-dcf55bed-0160-433c-8969-c114f06ed637 tempest-ProjectReaderTests-1781691025 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:23:55 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-dcf55bed-0160-433c-8969-c114f06ed637 tempest-ProjectReaderTests-1781691025 None] Deleted volume successfully.
Nov 05 15:23:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dcf55bed-0160-433c-8969-c114f06ed637 tempest-ProjectReaderTests-1781691025 None] Lock "cinder-488d256c-5c7f-4811-a8da-84b4acae53a0-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:56 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3283acf2-8f77-4dc6-a710-ed170e758025 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.ed838cae-324c-4ff9-9431-32d268b8e9c6" returned: 0 in 0.514s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3283acf2-8f77-4dc6-a710-ed170e758025 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:56 devstack sudo[107685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.info
Nov 05 15:23:56 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Flow 'volume_create_manager' (fa66f07d-d523-456c-bbf7-f11c986002f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec23b85a-aeab-46fa-8beb-5f19c6b045b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec23b85a-aeab-46fa-8beb-5f19c6b045b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1243229194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b66ea7-e424-47c7-8640-6406afde8c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7ff19a4fa44c489ecbe962d28938fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:56Z,use_quota=True,user_id='b13a9949463546bdba17ff98346fe5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b399aa9-15c9-4fef-95b8-c9b60ff55ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b399aa9-15c9-4fef-95b8-c9b60ff55ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d68d6e-9146-4c5c-afca-8c4fbf5e0883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d68d6e-9146-4c5c-afca-8c4fbf5e0883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01b66ea7-e424-47c7-8640-6406afde8c15', 'volume_name': 'volume-01b66ea7-e424-47c7-8640-6406afde8c15', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6248ed5c-e274-427a-801c-2b91ef484cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6248ed5c-e274-427a-801c-2b91ef484cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c1a2cf-502c-4755-88df-a7231bf52b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:56 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Volume 01b66ea7-e424-47c7-8640-6406afde8c15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01b66ea7-e424-47c7-8640-6406afde8c15', 'volume_size': 1}
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:56 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3283acf2-8f77-4dc6-a710-ed170e758025 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.info" returned: 0 in 0.278s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:56 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-3283acf2-8f77-4dc6-a710-ed170e758025 tempest-ProjectMemberTests-340429542 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.info is being set with open permissions: ugo+rw
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3283acf2-8f77-4dc6-a710-ed170e758025 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:56 devstack sudo[107688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.info
Nov 05 15:23:56 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:56 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3283acf2-8f77-4dc6-a710-ed170e758025 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.info" returned: 0 in 0.289s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3283acf2-8f77-4dc6-a710-ed170e758025 tempest-ProjectMemberTests-340429542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.752s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.459s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1243229194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b66ea7-e424-47c7-8640-6406afde8c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7ff19a4fa44c489ecbe962d28938fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:56Z,use_quota=True,user_id='b13a9949463546bdba17ff98346fe5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Creating volume 01b66ea7-e424-47c7-8640-6406afde8c15 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:23:56 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:23:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-01b66ea7-e424-47c7-8640-6406afde8c15 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:56 devstack sudo[107691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-01b66ea7-e424-47c7-8640-6406afde8c15 1073741824
Nov 05 15:23:56 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:56 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3283acf2-8f77-4dc6-a710-ed170e758025 tempest-ProjectMemberTests-340429542 None] Create snapshot completed successfully
Nov 05 15:23:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ccfde779-810c-499e-b3fc-5a4d1f633651 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-ed838cae-324c-4ff9-9431-32d268b8e9c6-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ccfde779-810c-499e-b3fc-5a4d1f633651 tempest-ProjectMemberTests-340429542 None] Lock "cinder-ed838cae-324c-4ff9-9431-32d268b8e9c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ccfde779-810c-499e-b3fc-5a4d1f633651 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-4df2610c-7b0c-4803-b561-007685bcfc9b" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ccfde779-810c-499e-b3fc-5a4d1f633651 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-4df2610c-7b0c-4803-b561-007685bcfc9b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ccfde779-810c-499e-b3fc-5a4d1f633651 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-ed838cae-324c-4ff9-9431-32d268b8e9c6" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ccfde779-810c-499e-b3fc-5a4d1f633651 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-ed838cae-324c-4ff9-9431-32d268b8e9c6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ccfde779-810c-499e-b3fc-5a4d1f633651 tempest-ProjectMemberTests-340429542 None] Deleting offline snapshot ed838cae-324c-4ff9-9431-32d268b8e9c6 of volume 4df2610c-7b0c-4803-b561-007685bcfc9b {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:23:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ccfde779-810c-499e-b3fc-5a4d1f633651 tempest-ProjectMemberTests-340429542 None] snapshot_file for this snap is: volume-4df2610c-7b0c-4803-b561-007685bcfc9b.ed838cae-324c-4ff9-9431-32d268b8e9c6 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:23:57 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a13c78-faf5-46b1-ac0e-aa057aba9fcd]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ccfde779-810c-499e-b3fc-5a4d1f633651 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.ed838cae-324c-4ff9-9431-32d268b8e9c6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:57 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-01b66ea7-e424-47c7-8640-6406afde8c15 1073741824" returned: 0 in 0.655s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-01b66ea7-e424-47c7-8640-6406afde8c15 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:57 devstack sudo[107698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-01b66ea7-e424-47c7-8640-6406afde8c15
Nov 05 15:23:57 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:57 devstack sudo[107697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.ed838cae-324c-4ff9-9431-32d268b8e9c6
Nov 05 15:23:57 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:57 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-01b66ea7-e424-47c7-8640-6406afde8c15" returned: 0 in 0.302s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:23:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c1a2cf-502c-4755-88df-a7231bf52b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01b66ea7-e424-47c7-8640-6406afde8c15', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eac5966-1d35-47c7-ae02-421170730f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:23:57 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Volume volume-01b66ea7-e424-47c7-8640-6406afde8c15 (01b66ea7-e424-47c7-8640-6406afde8c15): created successfully
Nov 05 15:23:57 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eac5966-1d35-47c7-ae02-421170730f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:23:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Flow 'volume_create_manager' (fa66f07d-d523-456c-bbf7-f11c986002f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:23:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ccfde779-810c-499e-b3fc-5a4d1f633651 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.ed838cae-324c-4ff9-9431-32d268b8e9c6" returned: 0 in 0.432s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ccfde779-810c-499e-b3fc-5a4d1f633651 tempest-ProjectMemberTests-340429542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4df2610c-7b0c-4803-b561-007685bcfc9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:23:57 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a606fc10-4586-4042-b86f-45b1a1ad5f93 tempest-ProjectReaderTests-1781691025 None] Created volume successfully.
Nov 05 15:23:57 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bb23b1-a56a-4659-b283-115f7c07332b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ccfde779-810c-499e-b3fc-5a4d1f633651 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:57 devstack sudo[107706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b
Nov 05 15:23:57 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:58 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ccfde779-810c-499e-b3fc-5a4d1f633651 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b" returned: 0 in 0.409s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ccfde779-810c-499e-b3fc-5a4d1f633651 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.ed838cae-324c-4ff9-9431-32d268b8e9c6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:58 devstack sudo[107711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.ed838cae-324c-4ff9-9431-32d268b8e9c6
Nov 05 15:23:58 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1bfccc3-4e5f-4032-90fb-4a0a80b195c8 tempest-ProjectReaderTests-1781691025 None] Acquiring lock "cinder-01b66ea7-e424-47c7-8640-6406afde8c15-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1bfccc3-4e5f-4032-90fb-4a0a80b195c8 tempest-ProjectReaderTests-1781691025 None] Lock "cinder-01b66ea7-e424-47c7-8640-6406afde8c15-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1bfccc3-4e5f-4032-90fb-4a0a80b195c8 tempest-ProjectReaderTests-1781691025 None] Acquiring lock "cinder-quobyte-01b66ea7-e424-47c7-8640-6406afde8c15" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1bfccc3-4e5f-4032-90fb-4a0a80b195c8 tempest-ProjectReaderTests-1781691025 None] Lock "cinder-quobyte-01b66ea7-e424-47c7-8640-6406afde8c15" acquired by "delete_volume" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:58 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef4e5f0-81f3-4808-8ab6-5f38925bc1b7]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1bfccc3-4e5f-4032-90fb-4a0a80b195c8 tempest-ProjectReaderTests-1781691025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-01b66ea7-e424-47c7-8640-6406afde8c15 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:58 devstack sudo[107713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-01b66ea7-e424-47c7-8640-6406afde8c15
Nov 05 15:23:58 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:58 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ccfde779-810c-499e-b3fc-5a4d1f633651 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.ed838cae-324c-4ff9-9431-32d268b8e9c6" returned: 0 in 0.498s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ccfde779-810c-499e-b3fc-5a4d1f633651 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.ed838cae-324c-4ff9-9431-32d268b8e9c6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:58 devstack sudo[107719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.ed838cae-324c-4ff9-9431-32d268b8e9c6
Nov 05 15:23:58 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:58 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1bfccc3-4e5f-4032-90fb-4a0a80b195c8 tempest-ProjectReaderTests-1781691025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-01b66ea7-e424-47c7-8640-6406afde8c15" returned: 0 in 0.499s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1bfccc3-4e5f-4032-90fb-4a0a80b195c8 tempest-ProjectReaderTests-1781691025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-01b66ea7-e424-47c7-8640-6406afde8c15 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:58 devstack sudo[107724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-01b66ea7-e424-47c7-8640-6406afde8c15
Nov 05 15:23:58 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:59 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ccfde779-810c-499e-b3fc-5a4d1f633651 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b.ed838cae-324c-4ff9-9431-32d268b8e9c6" returned: 0 in 0.310s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ccfde779-810c-499e-b3fc-5a4d1f633651 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-ed838cae-324c-4ff9-9431-32d268b8e9c6" released by "_delete_snapshot" :: held 1.800s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ccfde779-810c-499e-b3fc-5a4d1f633651 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-4df2610c-7b0c-4803-b561-007685bcfc9b" released by "delete_snapshot" :: held 1.831s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:59 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-ccfde779-810c-499e-b3fc-5a4d1f633651 tempest-ProjectMemberTests-340429542 None] Created reservations ['1031e811-b073-4491-bad1-ccec9bd174e7', 'f9acaaff-0ce5-4b32-9164-bdafdce98950', '7f7120cf-eaee-42e1-a162-ede6c1746172', '08f3f44a-43cc-4ad1-bc98-6d8563825388'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:59 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1bfccc3-4e5f-4032-90fb-4a0a80b195c8 tempest-ProjectReaderTests-1781691025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-01b66ea7-e424-47c7-8640-6406afde8c15" returned: 0 in 0.322s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1bfccc3-4e5f-4032-90fb-4a0a80b195c8 tempest-ProjectReaderTests-1781691025 None] Lock "cinder-quobyte-01b66ea7-e424-47c7-8640-6406afde8c15" released by "delete_volume" :: held 0.873s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:59 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ccfde779-810c-499e-b3fc-5a4d1f633651 tempest-ProjectMemberTests-340429542 None] Delete snapshot completed successfully.
Nov 05 15:23:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ccfde779-810c-499e-b3fc-5a4d1f633651 tempest-ProjectMemberTests-340429542 None] Lock "cinder-ed838cae-324c-4ff9-9431-32d268b8e9c6-delete_snapshot" released by "delete_snapshot" :: held 2.047s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:59 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b1bfccc3-4e5f-4032-90fb-4a0a80b195c8 tempest-ProjectReaderTests-1781691025 None] Created reservations ['46425d20-4ce2-47a6-8afc-55146e052a1b', '16af6a16-b745-4f0f-b1cb-203a5dd92e39', '5e3ded05-293a-46b8-a022-08f9f66eb198', '5e641127-5578-46d8-b12d-94348871f646'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:23:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b1bfccc3-4e5f-4032-90fb-4a0a80b195c8 tempest-ProjectReaderTests-1781691025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:23:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b1bfccc3-4e5f-4032-90fb-4a0a80b195c8 tempest-ProjectReaderTests-1781691025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:23:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b1bfccc3-4e5f-4032-90fb-4a0a80b195c8 tempest-ProjectReaderTests-1781691025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:23:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b1bfccc3-4e5f-4032-90fb-4a0a80b195c8 tempest-ProjectReaderTests-1781691025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:23:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b1bfccc3-4e5f-4032-90fb-4a0a80b195c8 tempest-ProjectReaderTests-1781691025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:23:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1bfccc3-4e5f-4032-90fb-4a0a80b195c8 tempest-ProjectReaderTests-1781691025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:59 devstack sudo[107729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:23:59 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:23:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-49c3a185-54ea-45ba-890f-9a678d107d80 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-4df2610c-7b0c-4803-b561-007685bcfc9b-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-49c3a185-54ea-45ba-890f-9a678d107d80 tempest-ProjectMemberTests-340429542 None] Lock "cinder-4df2610c-7b0c-4803-b561-007685bcfc9b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-49c3a185-54ea-45ba-890f-9a678d107d80 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-4df2610c-7b0c-4803-b561-007685bcfc9b" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:23:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-49c3a185-54ea-45ba-890f-9a678d107d80 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-4df2610c-7b0c-4803-b561-007685bcfc9b" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:23:59 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ace520-f63d-4220-8a47-1ac145b94627]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:23:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-49c3a185-54ea-45ba-890f-9a678d107d80 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:23:59 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root
Nov 05 15:23:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1bfccc3-4e5f-4032-90fb-4a0a80b195c8 tempest-ProjectReaderTests-1781691025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.363s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:23:59 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-b1bfccc3-4e5f-4032-90fb-4a0a80b195c8 tempest-ProjectReaderTests-1781691025 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:23:59 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b1bfccc3-4e5f-4032-90fb-4a0a80b195c8 tempest-ProjectReaderTests-1781691025 None] Deleted volume successfully.
Nov 05 15:23:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b1bfccc3-4e5f-4032-90fb-4a0a80b195c8 tempest-ProjectReaderTests-1781691025 None] Lock "cinder-01b66ea7-e424-47c7-8640-6406afde8c15-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:23:59 devstack sudo[107732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b
Nov 05 15:23:59 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:00 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-49c3a185-54ea-45ba-890f-9a678d107d80 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b" returned: 0 in 0.522s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-49c3a185-54ea-45ba-890f-9a678d107d80 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:00 devstack sudo[107738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b
Nov 05 15:24:00 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:00 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-49c3a185-54ea-45ba-890f-9a678d107d80 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-4df2610c-7b0c-4803-b561-007685bcfc9b" returned: 0 in 0.378s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-49c3a185-54ea-45ba-890f-9a678d107d80 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-4df2610c-7b0c-4803-b561-007685bcfc9b" released by "delete_volume" :: held 1.042s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:00 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-49c3a185-54ea-45ba-890f-9a678d107d80 tempest-ProjectMemberTests-340429542 None] Created reservations ['bb7a9ee9-a3c9-4753-a224-df743431aff7', '821cab7f-7aa5-41e7-943f-77ce8e4a38ee', '7674014a-55c6-4668-a363-2eaeb6c82a9d', '734576cb-a5d6-4582-9631-8bc8487b2d3b'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:24:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-49c3a185-54ea-45ba-890f-9a678d107d80 tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-49c3a185-54ea-45ba-890f-9a678d107d80 tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-49c3a185-54ea-45ba-890f-9a678d107d80 tempest-ProjectMemberTests-340429542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-49c3a185-54ea-45ba-890f-9a678d107d80 tempest-ProjectMemberTests-340429542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-49c3a185-54ea-45ba-890f-9a678d107d80 tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-49c3a185-54ea-45ba-890f-9a678d107d80 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:00 devstack sudo[107741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:24:00 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:01 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-49c3a185-54ea-45ba-890f-9a678d107d80 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.325s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:01 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-49c3a185-54ea-45ba-890f-9a678d107d80 tempest-ProjectMemberTests-340429542 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:24:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-49c3a185-54ea-45ba-890f-9a678d107d80 tempest-ProjectMemberTests-340429542 None] Deleted volume successfully.
Nov 05 15:24:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-49c3a185-54ea-45ba-890f-9a678d107d80 tempest-ProjectMemberTests-340429542 None] Lock "cinder-4df2610c-7b0c-4803-b561-007685bcfc9b-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:02 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:24:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Flow 'volume_create_manager' (4265ffbe-5003-4442-b628-3a22ced15f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:24:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa5a3997-373d-4ac6-8f17-081a67547c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa5a3997-373d-4ac6-8f17-081a67547c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1322433702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb7a198-8ebd-4dd8-b913-6e4d955d2d82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9e03f4a164bf48042da27edfd742d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:24:02Z,use_quota=True,user_id='d3585054b64542a1a174061b1731d371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d2b9371-c3df-4be0-ae15-04c4bd32a98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d2b9371-c3df-4be0-ae15-04c4bd32a98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57a201a-ac80-474c-b590-9febcbd04c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57a201a-ac80-474c-b590-9febcbd04c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cb7a198-8ebd-4dd8-b913-6e4d955d2d82', 'volume_name': 'volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00627324-8b03-40a8-95e7-e67e330e0913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00627324-8b03-40a8-95e7-e67e330e0913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2063ead-e2f5-43d9-8c84-392f21208b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:02 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Volume 7cb7a198-8ebd-4dd8-b913-6e4d955d2d82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82', 'volume_size': 1}
Nov 05 15:24:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1322433702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb7a198-8ebd-4dd8-b913-6e4d955d2d82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9e03f4a164bf48042da27edfd742d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:24:02Z,use_quota=True,user_id='d3585054b64542a1a174061b1731d371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:24:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Creating volume 7cb7a198-8ebd-4dd8-b913-6e4d955d2d82 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:24:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:24:02 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:24:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:02 devstack sudo[107745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82 1073741824
Nov 05 15:24:02 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:03 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82 1073741824" returned: 0 in 0.565s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:03 devstack sudo[107751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82
Nov 05 15:24:03 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:03 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82" returned: 0 in 0.288s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:24:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2063ead-e2f5-43d9-8c84-392f21208b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de071654-bdd5-4e2f-bef0-7ef0ca628814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:03 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Volume volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82 (7cb7a198-8ebd-4dd8-b913-6e4d955d2d82): created successfully
Nov 05 15:24:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de071654-bdd5-4e2f-bef0-7ef0ca628814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Flow 'volume_create_manager' (4265ffbe-5003-4442-b628-3a22ced15f31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:24:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-77750d11-3dee-4a41-86ae-f304d800d0d5 tempest-ProjectMemberTests-340429542 None] Created volume successfully.
Nov 05 15:24:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ae9c75da-8e6f-4a3a-93b3-774e608aeda8 tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ae9c75da-8e6f-4a3a-93b3-774e608aeda8 tempest-ProjectMemberTests-340429542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ae9c75da-8e6f-4a3a-93b3-774e608aeda8 tempest-ProjectMemberTests-340429542 None] Creating offline snapshot 2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8 of volume 7cb7a198-8ebd-4dd8-b913-6e4d955d2d82 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:24:04 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3196858e-3a91-49f2-8a06-a23a37b0d4de]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ae9c75da-8e6f-4a3a-93b3-774e608aeda8 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:04 devstack sudo[107754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82
Nov 05 15:24:04 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:04 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:24:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Flow 'volume_create_manager' (c85b2309-c3d6-4fef-8b6a-5d0b9a9a3353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:24:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d67a87-90c6-4699-ae7e-cfb5b2767fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d67a87-90c6-4699-ae7e-cfb5b2767fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1470010741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87350352-45dd-4574-ba55-82bc2f57c9c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16736df1a22c4f56ba32065d3eb06ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:24:05Z,use_quota=True,user_id='ad580d5687b249c789a394b23262b64a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a48078b-8540-4a7a-a962-12fa07288bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a48078b-8540-4a7a-a962-12fa07288bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddab1bd-92a2-469a-801c-af3e996236c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddab1bd-92a2-469a-801c-af3e996236c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87350352-45dd-4574-ba55-82bc2f57c9c6', 'volume_name': 'volume-87350352-45dd-4574-ba55-82bc2f57c9c6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1f4679-0581-416e-8ecb-b6625fe66445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1f4679-0581-416e-8ecb-b6625fe66445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da12595d-fd0e-4b2a-9379-1349c1a3f389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:05 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Volume 87350352-45dd-4574-ba55-82bc2f57c9c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87350352-45dd-4574-ba55-82bc2f57c9c6', 'volume_size': 1}
Nov 05 15:24:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:05 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ae9c75da-8e6f-4a3a-93b3-774e608aeda8 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82" returned: 0 in 0.369s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ae9c75da-8e6f-4a3a-93b3-774e608aeda8 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:05 devstack sudo[107759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8 1G
Nov 05 15:24:05 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:05 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ae9c75da-8e6f-4a3a-93b3-774e608aeda8 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8 1G" returned: 0 in 0.382s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ae9c75da-8e6f-4a3a-93b3-774e608aeda8 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:05 devstack sudo[107764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8
Nov 05 15:24:05 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:05 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ae9c75da-8e6f-4a3a-93b3-774e608aeda8 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8" returned: 0 in 0.279s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:05 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-ae9c75da-8e6f-4a3a-93b3-774e608aeda8 tempest-ProjectMemberTests-340429542 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8 is being set with open permissions: ugo+rw
Nov 05 15:24:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ae9c75da-8e6f-4a3a-93b3-774e608aeda8 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:05 devstack sudo[107769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8
Nov 05 15:24:05 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:06 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ae9c75da-8e6f-4a3a-93b3-774e608aeda8 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8" returned: 0 in 0.240s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ae9c75da-8e6f-4a3a-93b3-774e608aeda8 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:06 devstack sudo[107772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.info
Nov 05 15:24:06 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:06 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ae9c75da-8e6f-4a3a-93b3-774e608aeda8 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.info" returned: 0 in 0.252s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:06 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-ae9c75da-8e6f-4a3a-93b3-774e608aeda8 tempest-ProjectMemberTests-340429542 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.info is being set with open permissions: ugo+rw
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ae9c75da-8e6f-4a3a-93b3-774e608aeda8 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:06 devstack sudo[107775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.info
Nov 05 15:24:06 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:06 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ae9c75da-8e6f-4a3a-93b3-774e608aeda8 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.info" returned: 0 in 0.246s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ae9c75da-8e6f-4a3a-93b3-774e608aeda8 tempest-ProjectMemberTests-340429542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.861s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.548s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1470010741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87350352-45dd-4574-ba55-82bc2f57c9c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16736df1a22c4f56ba32065d3eb06ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:24:05Z,use_quota=True,user_id='ad580d5687b249c789a394b23262b64a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Creating volume 87350352-45dd-4574-ba55-82bc2f57c9c6 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:24:06 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-87350352-45dd-4574-ba55-82bc2f57c9c6 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:06 devstack sudo[107778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-87350352-45dd-4574-ba55-82bc2f57c9c6 1073741824
Nov 05 15:24:06 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ae9c75da-8e6f-4a3a-93b3-774e608aeda8 tempest-ProjectMemberTests-340429542 None] Create snapshot completed successfully
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c59f52a0-2ee9-451d-bbb1-7bdaedfaba79 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c59f52a0-2ee9-451d-bbb1-7bdaedfaba79 tempest-ProjectMemberTests-340429542 None] Lock "cinder-2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c59f52a0-2ee9-451d-bbb1-7bdaedfaba79 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c59f52a0-2ee9-451d-bbb1-7bdaedfaba79 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c59f52a0-2ee9-451d-bbb1-7bdaedfaba79 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c59f52a0-2ee9-451d-bbb1-7bdaedfaba79 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c59f52a0-2ee9-451d-bbb1-7bdaedfaba79 tempest-ProjectMemberTests-340429542 None] Deleting offline snapshot 2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8 of volume 7cb7a198-8ebd-4dd8-b913-6e4d955d2d82 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c59f52a0-2ee9-451d-bbb1-7bdaedfaba79 tempest-ProjectMemberTests-340429542 None] snapshot_file for this snap is: volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ec49ff-5b70-4adf-a573-5df9dce8d625]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c59f52a0-2ee9-451d-bbb1-7bdaedfaba79 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:07 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-87350352-45dd-4574-ba55-82bc2f57c9c6 1073741824" returned: 0 in 0.474s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:07 devstack sudo[107783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8
Nov 05 15:24:07 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-87350352-45dd-4574-ba55-82bc2f57c9c6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:07 devstack sudo[107786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-87350352-45dd-4574-ba55-82bc2f57c9c6
Nov 05 15:24:07 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:07 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c59f52a0-2ee9-451d-bbb1-7bdaedfaba79 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8" returned: 0 in 0.371s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c59f52a0-2ee9-451d-bbb1-7bdaedfaba79 tempest-ProjectMemberTests-340429542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:24:07 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f9ed50-dc3f-42a0-b5f3-6e2414883a34]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c59f52a0-2ee9-451d-bbb1-7bdaedfaba79 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:07 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-87350352-45dd-4574-ba55-82bc2f57c9c6" returned: 0 in 0.268s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:24:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da12595d-fd0e-4b2a-9379-1349c1a3f389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87350352-45dd-4574-ba55-82bc2f57c9c6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a4838e2-8e48-4db0-b867-652e6ab2e782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:07 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Volume volume-87350352-45dd-4574-ba55-82bc2f57c9c6 (87350352-45dd-4574-ba55-82bc2f57c9c6): created successfully
Nov 05 15:24:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a4838e2-8e48-4db0-b867-652e6ab2e782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Flow 'volume_create_manager' (c85b2309-c3d6-4fef-8b6a-5d0b9a9a3353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:24:07 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1fbd0310-faab-4f29-929f-0f5915d95f2c tempest-ProjectReaderTests-877590865 None] Created volume successfully.
Nov 05 15:24:07 devstack sudo[107792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82
Nov 05 15:24:07 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:07 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c59f52a0-2ee9-451d-bbb1-7bdaedfaba79 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82" returned: 0 in 0.355s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c59f52a0-2ee9-451d-bbb1-7bdaedfaba79 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:07 devstack sudo[107797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8
Nov 05 15:24:07 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:08 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c59f52a0-2ee9-451d-bbb1-7bdaedfaba79 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8" returned: 0 in 0.331s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c59f52a0-2ee9-451d-bbb1-7bdaedfaba79 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:08 devstack sudo[107802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8
Nov 05 15:24:08 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-52508339-004c-4472-ad2e-79a3cb176ac8 tempest-ProjectReaderTests-877590865 None] Acquiring lock "cinder-87350352-45dd-4574-ba55-82bc2f57c9c6-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-52508339-004c-4472-ad2e-79a3cb176ac8 tempest-ProjectReaderTests-877590865 None] Lock "cinder-87350352-45dd-4574-ba55-82bc2f57c9c6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-52508339-004c-4472-ad2e-79a3cb176ac8 tempest-ProjectReaderTests-877590865 None] Acquiring lock "cinder-quobyte-87350352-45dd-4574-ba55-82bc2f57c9c6" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:08 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-52508339-004c-4472-ad2e-79a3cb176ac8 tempest-ProjectReaderTests-877590865 None] Lock "cinder-quobyte-87350352-45dd-4574-ba55-82bc2f57c9c6" acquired by "delete_volume" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c59f52a0-2ee9-451d-bbb1-7bdaedfaba79 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82.2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8" returned: 0 in 0.285s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:08 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1655ca8-68b3-40eb-bc5f-fc9dbe576298]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-52508339-004c-4472-ad2e-79a3cb176ac8 tempest-ProjectReaderTests-877590865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-87350352-45dd-4574-ba55-82bc2f57c9c6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c59f52a0-2ee9-451d-bbb1-7bdaedfaba79 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8" released by "_delete_snapshot" :: held 1.458s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c59f52a0-2ee9-451d-bbb1-7bdaedfaba79 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82" released by "delete_snapshot" :: held 1.491s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:08 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-c59f52a0-2ee9-451d-bbb1-7bdaedfaba79 tempest-ProjectMemberTests-340429542 None] Created reservations ['cbd5054e-8d8a-4485-a6f7-4df370af29a3', 'c777f0bd-b522-4a78-ae29-8316f76caebf', '8b3ca23d-680c-4a48-b5d6-5d2b0c85a88d', '0dd728a4-6900-41a0-b61c-019c27df702e'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:24:08 devstack sudo[107805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-87350352-45dd-4574-ba55-82bc2f57c9c6
Nov 05 15:24:08 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:08 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c59f52a0-2ee9-451d-bbb1-7bdaedfaba79 tempest-ProjectMemberTests-340429542 None] Delete snapshot completed successfully.
Nov 05 15:24:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c59f52a0-2ee9-451d-bbb1-7bdaedfaba79 tempest-ProjectMemberTests-340429542 None] Lock "cinder-2ccdaffe-1c00-4d43-b67d-4b2d8e2b55c8-delete_snapshot" released by "delete_snapshot" :: held 1.645s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:08 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-52508339-004c-4472-ad2e-79a3cb176ac8 tempest-ProjectReaderTests-877590865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-87350352-45dd-4574-ba55-82bc2f57c9c6" returned: 0 in 0.366s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-52508339-004c-4472-ad2e-79a3cb176ac8 tempest-ProjectReaderTests-877590865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-87350352-45dd-4574-ba55-82bc2f57c9c6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:08 devstack sudo[107810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-87350352-45dd-4574-ba55-82bc2f57c9c6
Nov 05 15:24:08 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:08 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-52508339-004c-4472-ad2e-79a3cb176ac8 tempest-ProjectReaderTests-877590865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-87350352-45dd-4574-ba55-82bc2f57c9c6" returned: 0 in 0.246s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-52508339-004c-4472-ad2e-79a3cb176ac8 tempest-ProjectReaderTests-877590865 None] Lock "cinder-quobyte-87350352-45dd-4574-ba55-82bc2f57c9c6" released by "delete_volume" :: held 0.668s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ab7b5d03-8ac5-49e8-8a75-3adcc91e02a9 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ab7b5d03-8ac5-49e8-8a75-3adcc91e02a9 tempest-ProjectMemberTests-340429542 None] Lock "cinder-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-52508339-004c-4472-ad2e-79a3cb176ac8 tempest-ProjectReaderTests-877590865 None] Created reservations ['eb58ab51-9059-4d07-a4fa-ae9dcd514d44', 'cb8cf551-95de-422f-b216-5d4d62ebeea1', 'a61118a0-fb33-487b-9d36-b19464a3134e', 'd2913faf-642d-4cac-95f5-56735b04b432'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ab7b5d03-8ac5-49e8-8a75-3adcc91e02a9 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ab7b5d03-8ac5-49e8-8a75-3adcc91e02a9 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[055e71ae-c984-4fe9-a244-94d1500626c0]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ab7b5d03-8ac5-49e8-8a75-3adcc91e02a9 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-52508339-004c-4472-ad2e-79a3cb176ac8 tempest-ProjectReaderTests-877590865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-52508339-004c-4472-ad2e-79a3cb176ac8 tempest-ProjectReaderTests-877590865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-52508339-004c-4472-ad2e-79a3cb176ac8 tempest-ProjectReaderTests-877590865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-52508339-004c-4472-ad2e-79a3cb176ac8 tempest-ProjectReaderTests-877590865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-52508339-004c-4472-ad2e-79a3cb176ac8 tempest-ProjectReaderTests-877590865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-52508339-004c-4472-ad2e-79a3cb176ac8 tempest-ProjectReaderTests-877590865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:09 devstack sudo[107814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:24:09 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:09 devstack sudo[107813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82
Nov 05 15:24:09 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:09 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-52508339-004c-4472-ad2e-79a3cb176ac8 tempest-ProjectReaderTests-877590865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.252s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-52508339-004c-4472-ad2e-79a3cb176ac8 tempest-ProjectReaderTests-877590865 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:24:09 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-52508339-004c-4472-ad2e-79a3cb176ac8 tempest-ProjectReaderTests-877590865 None] Deleted volume successfully.
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-52508339-004c-4472-ad2e-79a3cb176ac8 tempest-ProjectReaderTests-877590865 None] Lock "cinder-87350352-45dd-4574-ba55-82bc2f57c9c6-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:09 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ab7b5d03-8ac5-49e8-8a75-3adcc91e02a9 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82" returned: 0 in 0.396s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ab7b5d03-8ac5-49e8-8a75-3adcc91e02a9 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:09 devstack sudo[107822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82
Nov 05 15:24:09 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:09 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ab7b5d03-8ac5-49e8-8a75-3adcc91e02a9 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82" returned: 0 in 0.265s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ab7b5d03-8ac5-49e8-8a75-3adcc91e02a9 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82" released by "delete_volume" :: held 0.735s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Flow 'volume_create_manager' (2bfe1925-a617-461d-b141-0cfd3138daf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99028f0c-03ca-433d-ba3b-645612fe3bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-ab7b5d03-8ac5-49e8-8a75-3adcc91e02a9 tempest-ProjectMemberTests-340429542 None] Created reservations ['5dc13f7f-fecf-4136-aae8-99131a9b9fb8', '71426bbf-b9c5-4ff4-b083-d32db091d190', '975b40c9-11e1-4046-96dd-ea600643a765', 'bba99346-2df5-4d23-a878-4086c947e26f'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99028f0c-03ca-433d-ba3b-645612fe3bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1713542692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ca2be4-4e22-4a96-a438-5799bd6bf0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16736df1a22c4f56ba32065d3eb06ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:24:10Z,use_quota=True,user_id='ad580d5687b249c789a394b23262b64a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f311a3a0-3d71-4a14-8786-bf5cbce00a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f311a3a0-3d71-4a14-8786-bf5cbce00a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41318ed9-f725-453c-b543-b3156bd396b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41318ed9-f725-453c-b543-b3156bd396b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62ca2be4-4e22-4a96-a438-5799bd6bf0c0', 'volume_name': 'volume-62ca2be4-4e22-4a96-a438-5799bd6bf0c0', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f328dd8-9f59-4876-8397-a4a3fe2f288a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f328dd8-9f59-4876-8397-a4a3fe2f288a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (221e6a1b-e8f2-4255-a896-c7008928ac15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:10 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Volume 62ca2be4-4e22-4a96-a438-5799bd6bf0c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62ca2be4-4e22-4a96-a438-5799bd6bf0c0', 'volume_size': 1}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1713542692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ca2be4-4e22-4a96-a438-5799bd6bf0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16736df1a22c4f56ba32065d3eb06ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:24:10Z,use_quota=True,user_id='ad580d5687b249c789a394b23262b64a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Creating volume 62ca2be4-4e22-4a96-a438-5799bd6bf0c0 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:24:10 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-62ca2be4-4e22-4a96-a438-5799bd6bf0c0 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:10 devstack sudo[107825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-62ca2be4-4e22-4a96-a438-5799bd6bf0c0 1073741824
Nov 05 15:24:10 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ab7b5d03-8ac5-49e8-8a75-3adcc91e02a9 tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ab7b5d03-8ac5-49e8-8a75-3adcc91e02a9 tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ab7b5d03-8ac5-49e8-8a75-3adcc91e02a9 tempest-ProjectMemberTests-340429542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ab7b5d03-8ac5-49e8-8a75-3adcc91e02a9 tempest-ProjectMemberTests-340429542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ab7b5d03-8ac5-49e8-8a75-3adcc91e02a9 tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ab7b5d03-8ac5-49e8-8a75-3adcc91e02a9 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:10 devstack sudo[107827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:24:10 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:10 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ab7b5d03-8ac5-49e8-8a75-3adcc91e02a9 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.250s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-ab7b5d03-8ac5-49e8-8a75-3adcc91e02a9 tempest-ProjectMemberTests-340429542 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:24:10 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ab7b5d03-8ac5-49e8-8a75-3adcc91e02a9 tempest-ProjectMemberTests-340429542 None] Deleted volume successfully.
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ab7b5d03-8ac5-49e8-8a75-3adcc91e02a9 tempest-ProjectMemberTests-340429542 None] Lock "cinder-7cb7a198-8ebd-4dd8-b913-6e4d955d2d82-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:10 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-62ca2be4-4e22-4a96-a438-5799bd6bf0c0 1073741824" returned: 0 in 0.489s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-62ca2be4-4e22-4a96-a438-5799bd6bf0c0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:10 devstack sudo[107833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-62ca2be4-4e22-4a96-a438-5799bd6bf0c0
Nov 05 15:24:10 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Flow 'volume_create_manager' (f0cb7a7b-8a4f-4bff-9099-7e586baa8a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30dfa079-169c-46d6-8c28-4e7d72ced74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30dfa079-169c-46d6-8c28-4e7d72ced74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-371363316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd7ded5b-0e3e-4589-a0bb-affce2ff98ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9e03f4a164bf48042da27edfd742d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:24:11Z,use_quota=True,user_id='d3585054b64542a1a174061b1731d371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33bd27cb-3cc6-4357-926e-42a63d4a2d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33bd27cb-3cc6-4357-926e-42a63d4a2d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65236694-ceb9-4429-9ed1-79e8312fb511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65236694-ceb9-4429-9ed1-79e8312fb511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd7ded5b-0e3e-4589-a0bb-affce2ff98ee', 'volume_name': 'volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52301856-9973-4b13-b3f3-01a05e7eebcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52301856-9973-4b13-b3f3-01a05e7eebcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9cac56d-4fa6-4f85-8563-a638ea048b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:10 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Volume cd7ded5b-0e3e-4589-a0bb-affce2ff98ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee', 'volume_size': 1}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:10 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-62ca2be4-4e22-4a96-a438-5799bd6bf0c0" returned: 0 in 0.257s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.026s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-371363316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd7ded5b-0e3e-4589-a0bb-affce2ff98ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9e03f4a164bf48042da27edfd742d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:24:11Z,use_quota=True,user_id='d3585054b64542a1a174061b1731d371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Creating volume cd7ded5b-0e3e-4589-a0bb-affce2ff98ee {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:24:10 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (221e6a1b-e8f2-4255-a896-c7008928ac15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62ca2be4-4e22-4a96-a438-5799bd6bf0c0', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:10 devstack sudo[107836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee 1073741824
Nov 05 15:24:10 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d79db95e-2309-4414-8090-10d4d526a713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:10 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Volume volume-62ca2be4-4e22-4a96-a438-5799bd6bf0c0 (62ca2be4-4e22-4a96-a438-5799bd6bf0c0): created successfully
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d79db95e-2309-4414-8090-10d4d526a713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Flow 'volume_create_manager' (2bfe1925-a617-461d-b141-0cfd3138daf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:24:10 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ec6a4f36-3952-411e-9deb-9b101d3a6406 tempest-ProjectReaderTests-877590865 None] Created volume successfully.
Nov 05 15:24:11 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee 1073741824" returned: 0 in 0.429s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:11 devstack sudo[107841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee
Nov 05 15:24:11 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:11 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee" returned: 0 in 0.249s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:24:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9cac56d-4fa6-4f85-8563-a638ea048b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ffe3a4-3857-422d-b197-a7540789fb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:11 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Volume volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee (cd7ded5b-0e3e-4589-a0bb-affce2ff98ee): created successfully
Nov 05 15:24:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ffe3a4-3857-422d-b197-a7540789fb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Flow 'volume_create_manager' (f0cb7a7b-8a4f-4bff-9099-7e586baa8a17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:24:11 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-71018f69-f657-4c8b-8505-d1fadb41df72 tempest-ProjectMemberTests-340429542 None] Created volume successfully.
Nov 05 15:24:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-513098ea-9543-4a25-9bb3-286be0364682 tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-513098ea-9543-4a25-9bb3-286be0364682 tempest-ProjectMemberTests-340429542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-513098ea-9543-4a25-9bb3-286be0364682 tempest-ProjectMemberTests-340429542 None] Creating offline snapshot 15be8274-1a86-4963-8188-d84f55ede7ea of volume cd7ded5b-0e3e-4589-a0bb-affce2ff98ee {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:24:11 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f966e4ad-01f0-4241-bd3e-9cde84265146]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-513098ea-9543-4a25-9bb3-286be0364682 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:11 devstack sudo[107844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee
Nov 05 15:24:11 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-be211765-0399-40c9-a86a-433aefc7cc93 tempest-ProjectReaderTests-877590865 None] Acquiring lock "cinder-62ca2be4-4e22-4a96-a438-5799bd6bf0c0-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-be211765-0399-40c9-a86a-433aefc7cc93 tempest-ProjectReaderTests-877590865 None] Lock "cinder-62ca2be4-4e22-4a96-a438-5799bd6bf0c0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-be211765-0399-40c9-a86a-433aefc7cc93 tempest-ProjectReaderTests-877590865 None] Acquiring lock "cinder-quobyte-62ca2be4-4e22-4a96-a438-5799bd6bf0c0" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-be211765-0399-40c9-a86a-433aefc7cc93 tempest-ProjectReaderTests-877590865 None] Lock "cinder-quobyte-62ca2be4-4e22-4a96-a438-5799bd6bf0c0" acquired by "delete_volume" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:12 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[60997667-6a31-4e52-8b7a-bccad5662d57]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-be211765-0399-40c9-a86a-433aefc7cc93 tempest-ProjectReaderTests-877590865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-62ca2be4-4e22-4a96-a438-5799bd6bf0c0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:12 devstack sudo[107846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-62ca2be4-4e22-4a96-a438-5799bd6bf0c0
Nov 05 15:24:12 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:12 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-513098ea-9543-4a25-9bb3-286be0364682 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee" returned: 0 in 0.378s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-513098ea-9543-4a25-9bb3-286be0364682 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.15be8274-1a86-4963-8188-d84f55ede7ea 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:12 devstack sudo[107851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.15be8274-1a86-4963-8188-d84f55ede7ea 1G
Nov 05 15:24:12 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:12 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-be211765-0399-40c9-a86a-433aefc7cc93 tempest-ProjectReaderTests-877590865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-62ca2be4-4e22-4a96-a438-5799bd6bf0c0" returned: 0 in 0.377s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-be211765-0399-40c9-a86a-433aefc7cc93 tempest-ProjectReaderTests-877590865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-62ca2be4-4e22-4a96-a438-5799bd6bf0c0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:12 devstack sudo[107859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-62ca2be4-4e22-4a96-a438-5799bd6bf0c0
Nov 05 15:24:12 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:12 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-513098ea-9543-4a25-9bb3-286be0364682 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.15be8274-1a86-4963-8188-d84f55ede7ea 1G" returned: 0 in 0.409s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-513098ea-9543-4a25-9bb3-286be0364682 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.15be8274-1a86-4963-8188-d84f55ede7ea {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:12 devstack sudo[107861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.15be8274-1a86-4963-8188-d84f55ede7ea
Nov 05 15:24:12 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:12 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-be211765-0399-40c9-a86a-433aefc7cc93 tempest-ProjectReaderTests-877590865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-62ca2be4-4e22-4a96-a438-5799bd6bf0c0" returned: 0 in 0.257s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-be211765-0399-40c9-a86a-433aefc7cc93 tempest-ProjectReaderTests-877590865 None] Lock "cinder-quobyte-62ca2be4-4e22-4a96-a438-5799bd6bf0c0" released by "delete_volume" :: held 0.682s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:12 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-be211765-0399-40c9-a86a-433aefc7cc93 tempest-ProjectReaderTests-877590865 None] Created reservations ['cfe7881a-0d63-40b2-ae01-7ad17f528d84', 'd046f98c-467d-45ff-984b-2418d12fd075', '64d68a5c-9747-4049-a0e0-fba454d66246', 'bb1a8999-ffda-4732-b055-c6f1f3b98ff0'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:24:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-be211765-0399-40c9-a86a-433aefc7cc93 tempest-ProjectReaderTests-877590865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-be211765-0399-40c9-a86a-433aefc7cc93 tempest-ProjectReaderTests-877590865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-be211765-0399-40c9-a86a-433aefc7cc93 tempest-ProjectReaderTests-877590865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-be211765-0399-40c9-a86a-433aefc7cc93 tempest-ProjectReaderTests-877590865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-be211765-0399-40c9-a86a-433aefc7cc93 tempest-ProjectReaderTests-877590865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-be211765-0399-40c9-a86a-433aefc7cc93 tempest-ProjectReaderTests-877590865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:12 devstack sudo[107868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:24:12 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:12 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-513098ea-9543-4a25-9bb3-286be0364682 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.15be8274-1a86-4963-8188-d84f55ede7ea" returned: 0 in 0.305s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:12 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-513098ea-9543-4a25-9bb3-286be0364682 tempest-ProjectMemberTests-340429542 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.15be8274-1a86-4963-8188-d84f55ede7ea is being set with open permissions: ugo+rw
Nov 05 15:24:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-513098ea-9543-4a25-9bb3-286be0364682 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.15be8274-1a86-4963-8188-d84f55ede7ea {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:13 devstack sudo[107870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.15be8274-1a86-4963-8188-d84f55ede7ea
Nov 05 15:24:13 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:13 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-be211765-0399-40c9-a86a-433aefc7cc93 tempest-ProjectReaderTests-877590865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.273s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-be211765-0399-40c9-a86a-433aefc7cc93 tempest-ProjectReaderTests-877590865 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:24:13 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-be211765-0399-40c9-a86a-433aefc7cc93 tempest-ProjectReaderTests-877590865 None] Deleted volume successfully.
Nov 05 15:24:13 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-513098ea-9543-4a25-9bb3-286be0364682 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.15be8274-1a86-4963-8188-d84f55ede7ea" returned: 0 in 0.246s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-be211765-0399-40c9-a86a-433aefc7cc93 tempest-ProjectReaderTests-877590865 None] Lock "cinder-62ca2be4-4e22-4a96-a438-5799bd6bf0c0-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-513098ea-9543-4a25-9bb3-286be0364682 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:13 devstack sudo[107874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.info
Nov 05 15:24:13 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:13 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-513098ea-9543-4a25-9bb3-286be0364682 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.info" returned: 0 in 0.278s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:13 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-513098ea-9543-4a25-9bb3-286be0364682 tempest-ProjectMemberTests-340429542 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.info is being set with open permissions: ugo+rw
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-513098ea-9543-4a25-9bb3-286be0364682 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:13 devstack sudo[107877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.info
Nov 05 15:24:13 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Flow 'volume_create_manager' (14817785-3db9-4a21-ad7d-76c52410b779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efaa5879-2713-45fe-82c5-18cd4888b348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efaa5879-2713-45fe-82c5-18cd4888b348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-745736556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c445057-b459-4ba7-947d-a2b326480769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16736df1a22c4f56ba32065d3eb06ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:24:14Z,use_quota=True,user_id='ad580d5687b249c789a394b23262b64a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (733c1cfc-dd40-4386-967e-c7d9316b7013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (733c1cfc-dd40-4386-967e-c7d9316b7013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd29c039-a682-4dd5-94db-7f7fed1fc1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd29c039-a682-4dd5-94db-7f7fed1fc1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c445057-b459-4ba7-947d-a2b326480769', 'volume_name': 'volume-1c445057-b459-4ba7-947d-a2b326480769', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08fb82f-25a4-495e-b4fe-bb58d5c8a629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08fb82f-25a4-495e-b4fe-bb58d5c8a629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb14941b-ef39-4887-a3e3-236ed091376f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:13 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Volume 1c445057-b459-4ba7-947d-a2b326480769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c445057-b459-4ba7-947d-a2b326480769', 'volume_size': 1}
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:13 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-513098ea-9543-4a25-9bb3-286be0364682 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.info" returned: 0 in 0.247s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-513098ea-9543-4a25-9bb3-286be0364682 tempest-ProjectMemberTests-340429542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.958s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.052s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-745736556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c445057-b459-4ba7-947d-a2b326480769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16736df1a22c4f56ba32065d3eb06ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:24:14Z,use_quota=True,user_id='ad580d5687b249c789a394b23262b64a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Creating volume 1c445057-b459-4ba7-947d-a2b326480769 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:24:13 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:24:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c445057-b459-4ba7-947d-a2b326480769 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:13 devstack sudo[107880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c445057-b459-4ba7-947d-a2b326480769 1073741824
Nov 05 15:24:13 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:13 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-513098ea-9543-4a25-9bb3-286be0364682 tempest-ProjectMemberTests-340429542 None] Create snapshot completed successfully
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-72cdcb47-0d1a-4dbb-b2d0-07d8d09f8846 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-15be8274-1a86-4963-8188-d84f55ede7ea-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-72cdcb47-0d1a-4dbb-b2d0-07d8d09f8846 tempest-ProjectMemberTests-340429542 None] Lock "cinder-15be8274-1a86-4963-8188-d84f55ede7ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-72cdcb47-0d1a-4dbb-b2d0-07d8d09f8846 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-72cdcb47-0d1a-4dbb-b2d0-07d8d09f8846 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-72cdcb47-0d1a-4dbb-b2d0-07d8d09f8846 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-15be8274-1a86-4963-8188-d84f55ede7ea" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-72cdcb47-0d1a-4dbb-b2d0-07d8d09f8846 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-15be8274-1a86-4963-8188-d84f55ede7ea" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-72cdcb47-0d1a-4dbb-b2d0-07d8d09f8846 tempest-ProjectMemberTests-340429542 None] Deleting offline snapshot 15be8274-1a86-4963-8188-d84f55ede7ea of volume cd7ded5b-0e3e-4589-a0bb-affce2ff98ee {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-72cdcb47-0d1a-4dbb-b2d0-07d8d09f8846 tempest-ProjectMemberTests-340429542 None] snapshot_file for this snap is: volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.15be8274-1a86-4963-8188-d84f55ede7ea {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fb04d4-d8fe-48a7-863e-8defd57ddeae]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-72cdcb47-0d1a-4dbb-b2d0-07d8d09f8846 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.15be8274-1a86-4963-8188-d84f55ede7ea {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:14 devstack sudo[107885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.15be8274-1a86-4963-8188-d84f55ede7ea
Nov 05 15:24:14 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:14 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c445057-b459-4ba7-947d-a2b326480769 1073741824" returned: 0 in 0.443s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c445057-b459-4ba7-947d-a2b326480769 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:14 devstack sudo[107888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c445057-b459-4ba7-947d-a2b326480769
Nov 05 15:24:14 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:14 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-72cdcb47-0d1a-4dbb-b2d0-07d8d09f8846 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.15be8274-1a86-4963-8188-d84f55ede7ea" returned: 0 in 0.393s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-72cdcb47-0d1a-4dbb-b2d0-07d8d09f8846 tempest-ProjectMemberTests-340429542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e186d6-a9e8-4256-9dfa-5dc664fec2b7]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-72cdcb47-0d1a-4dbb-b2d0-07d8d09f8846 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:14 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c445057-b459-4ba7-947d-a2b326480769" returned: 0 in 0.253s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb14941b-ef39-4887-a3e3-236ed091376f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c445057-b459-4ba7-947d-a2b326480769', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab6b07d8-04c8-459f-80bb-15bcddd879d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:14 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Volume volume-1c445057-b459-4ba7-947d-a2b326480769 (1c445057-b459-4ba7-947d-a2b326480769): created successfully
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab6b07d8-04c8-459f-80bb-15bcddd879d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Flow 'volume_create_manager' (14817785-3db9-4a21-ad7d-76c52410b779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:24:14 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2b872d13-72bb-4c72-8378-d78e2fddf09c tempest-ProjectReaderTests-877590865 None] Created volume successfully.
Nov 05 15:24:14 devstack sudo[107894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee
Nov 05 15:24:14 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:14 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-72cdcb47-0d1a-4dbb-b2d0-07d8d09f8846 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee" returned: 0 in 0.385s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-72cdcb47-0d1a-4dbb-b2d0-07d8d09f8846 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.15be8274-1a86-4963-8188-d84f55ede7ea {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:14 devstack sudo[107900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.15be8274-1a86-4963-8188-d84f55ede7ea
Nov 05 15:24:14 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:15 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-72cdcb47-0d1a-4dbb-b2d0-07d8d09f8846 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.15be8274-1a86-4963-8188-d84f55ede7ea" returned: 0 in 0.322s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-72cdcb47-0d1a-4dbb-b2d0-07d8d09f8846 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.15be8274-1a86-4963-8188-d84f55ede7ea {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:15 devstack sudo[107906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.15be8274-1a86-4963-8188-d84f55ede7ea
Nov 05 15:24:15 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:15 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-72cdcb47-0d1a-4dbb-b2d0-07d8d09f8846 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee.15be8274-1a86-4963-8188-d84f55ede7ea" returned: 0 in 0.239s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-72cdcb47-0d1a-4dbb-b2d0-07d8d09f8846 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-15be8274-1a86-4963-8188-d84f55ede7ea" released by "_delete_snapshot" :: held 1.440s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-72cdcb47-0d1a-4dbb-b2d0-07d8d09f8846 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee" released by "delete_snapshot" :: held 1.468s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:15 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-72cdcb47-0d1a-4dbb-b2d0-07d8d09f8846 tempest-ProjectMemberTests-340429542 None] Created reservations ['3538257c-add7-40fe-bd9b-0fe14fc91692', '67819cd1-285b-407f-be07-5d516a2079f2', '48b6d85a-5b49-47d0-8819-dc00d983d11a', '15699492-def5-4dc0-98ba-dca080bf2e53'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:24:15 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-72cdcb47-0d1a-4dbb-b2d0-07d8d09f8846 tempest-ProjectMemberTests-340429542 None] Delete snapshot completed successfully.
Nov 05 15:24:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-72cdcb47-0d1a-4dbb-b2d0-07d8d09f8846 tempest-ProjectMemberTests-340429542 None] Lock "cinder-15be8274-1a86-4963-8188-d84f55ede7ea-delete_snapshot" released by "delete_snapshot" :: held 1.597s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a7078ac9-acb0-4865-868f-51b465960d49 tempest-ProjectReaderTests-877590865 None] Acquiring lock "cinder-1c445057-b459-4ba7-947d-a2b326480769-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a7078ac9-acb0-4865-868f-51b465960d49 tempest-ProjectReaderTests-877590865 None] Lock "cinder-1c445057-b459-4ba7-947d-a2b326480769-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a7078ac9-acb0-4865-868f-51b465960d49 tempest-ProjectReaderTests-877590865 None] Acquiring lock "cinder-quobyte-1c445057-b459-4ba7-947d-a2b326480769" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a7078ac9-acb0-4865-868f-51b465960d49 tempest-ProjectReaderTests-877590865 None] Lock "cinder-quobyte-1c445057-b459-4ba7-947d-a2b326480769" acquired by "delete_volume" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:15 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8273ef4-c276-4f7c-a176-289bbe03e7ec]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a7078ac9-acb0-4865-868f-51b465960d49 tempest-ProjectReaderTests-877590865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c445057-b459-4ba7-947d-a2b326480769 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:16 devstack sudo[107909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c445057-b459-4ba7-947d-a2b326480769
Nov 05 15:24:16 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-827f6eee-a08e-4b8c-96fc-7f2074953a8b tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-827f6eee-a08e-4b8c-96fc-7f2074953a8b tempest-ProjectMemberTests-340429542 None] Lock "cinder-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-827f6eee-a08e-4b8c-96fc-7f2074953a8b tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-827f6eee-a08e-4b8c-96fc-7f2074953a8b tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:16 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a7078ac9-acb0-4865-868f-51b465960d49 tempest-ProjectReaderTests-877590865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c445057-b459-4ba7-947d-a2b326480769" returned: 0 in 0.385s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a7078ac9-acb0-4865-868f-51b465960d49 tempest-ProjectReaderTests-877590865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c445057-b459-4ba7-947d-a2b326480769 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:16 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a84cf4-f694-46a6-9905-3e571377e1fd]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-827f6eee-a08e-4b8c-96fc-7f2074953a8b tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:16 devstack sudo[107914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c445057-b459-4ba7-947d-a2b326480769
Nov 05 15:24:16 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:16 devstack sudo[107915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee
Nov 05 15:24:16 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:16 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a7078ac9-acb0-4865-868f-51b465960d49 tempest-ProjectReaderTests-877590865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-1c445057-b459-4ba7-947d-a2b326480769" returned: 0 in 0.249s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a7078ac9-acb0-4865-868f-51b465960d49 tempest-ProjectReaderTests-877590865 None] Lock "cinder-quobyte-1c445057-b459-4ba7-947d-a2b326480769" released by "delete_volume" :: held 0.681s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:16 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-a7078ac9-acb0-4865-868f-51b465960d49 tempest-ProjectReaderTests-877590865 None] Created reservations ['417a4ce9-63a3-49d4-8800-c9d02262258e', '0cde360c-46a5-4e29-821c-5f833e1c7f26', '1469b642-ac0d-4a40-814b-3c30d0f9cad4', '3c55427f-bcde-4c26-9eff-4003a628e9df'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:24:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a7078ac9-acb0-4865-868f-51b465960d49 tempest-ProjectReaderTests-877590865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a7078ac9-acb0-4865-868f-51b465960d49 tempest-ProjectReaderTests-877590865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a7078ac9-acb0-4865-868f-51b465960d49 tempest-ProjectReaderTests-877590865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a7078ac9-acb0-4865-868f-51b465960d49 tempest-ProjectReaderTests-877590865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a7078ac9-acb0-4865-868f-51b465960d49 tempest-ProjectReaderTests-877590865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a7078ac9-acb0-4865-868f-51b465960d49 tempest-ProjectReaderTests-877590865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:16 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-827f6eee-a08e-4b8c-96fc-7f2074953a8b tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee" returned: 0 in 0.388s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-827f6eee-a08e-4b8c-96fc-7f2074953a8b tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:16 devstack sudo[107922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:24:16 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:16 devstack sudo[107923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee
Nov 05 15:24:16 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:16 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a7078ac9-acb0-4865-868f-51b465960d49 tempest-ProjectReaderTests-877590865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.263s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:16 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a7078ac9-acb0-4865-868f-51b465960d49 tempest-ProjectReaderTests-877590865 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:24:16 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:16 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a7078ac9-acb0-4865-868f-51b465960d49 tempest-ProjectReaderTests-877590865 None] Deleted volume successfully.
Nov 05 15:24:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-827f6eee-a08e-4b8c-96fc-7f2074953a8b tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee" returned: 0 in 0.265s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-827f6eee-a08e-4b8c-96fc-7f2074953a8b tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee" released by "delete_volume" :: held 0.735s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a7078ac9-acb0-4865-868f-51b465960d49 tempest-ProjectReaderTests-877590865 None] Lock "cinder-1c445057-b459-4ba7-947d-a2b326480769-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-827f6eee-a08e-4b8c-96fc-7f2074953a8b tempest-ProjectMemberTests-340429542 None] Created reservations ['84389dc8-6c70-4aa8-ba27-9bff5dc0585f', '07123d16-6335-4c5b-9841-64a134451b54', '68178ea2-66b0-42f9-be3b-8a60524883cb', 'db5d6e9b-2f66-4d50-88af-7fb2a80f264e'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-827f6eee-a08e-4b8c-96fc-7f2074953a8b tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-827f6eee-a08e-4b8c-96fc-7f2074953a8b tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-827f6eee-a08e-4b8c-96fc-7f2074953a8b tempest-ProjectMemberTests-340429542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-827f6eee-a08e-4b8c-96fc-7f2074953a8b tempest-ProjectMemberTests-340429542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-827f6eee-a08e-4b8c-96fc-7f2074953a8b tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-827f6eee-a08e-4b8c-96fc-7f2074953a8b tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:17 devstack sudo[107928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:24:17 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:17 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-827f6eee-a08e-4b8c-96fc-7f2074953a8b tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.260s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-827f6eee-a08e-4b8c-96fc-7f2074953a8b tempest-ProjectMemberTests-340429542 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:24:17 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-827f6eee-a08e-4b8c-96fc-7f2074953a8b tempest-ProjectMemberTests-340429542 None] Deleted volume successfully.
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-827f6eee-a08e-4b8c-96fc-7f2074953a8b tempest-ProjectMemberTests-340429542 None] Lock "cinder-cd7ded5b-0e3e-4589-a0bb-affce2ff98ee-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Flow 'volume_create_manager' (c808398f-132f-43bb-98e1-60d21ccaa3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3143748-ec53-4b76-b8f0-7e8c5097cfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3143748-ec53-4b76-b8f0-7e8c5097cfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1310680920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b933f7b7-fb95-4652-b96d-25068095d1a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16736df1a22c4f56ba32065d3eb06ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:24:17Z,use_quota=True,user_id='ad580d5687b249c789a394b23262b64a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e65034-836c-434e-97f9-1a863e024963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e65034-836c-434e-97f9-1a863e024963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5284259c-2ca3-4a61-bec3-f86a318235bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5284259c-2ca3-4a61-bec3-f86a318235bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b933f7b7-fb95-4652-b96d-25068095d1a6', 'volume_name': 'volume-b933f7b7-fb95-4652-b96d-25068095d1a6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3666479c-a1e6-443d-a489-6a7ae05d4dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3666479c-a1e6-443d-a489-6a7ae05d4dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b55c66c-29da-44b0-9e15-51d27fb7e394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:17 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Volume b933f7b7-fb95-4652-b96d-25068095d1a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b933f7b7-fb95-4652-b96d-25068095d1a6', 'volume_size': 1}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1310680920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b933f7b7-fb95-4652-b96d-25068095d1a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16736df1a22c4f56ba32065d3eb06ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:24:17Z,use_quota=True,user_id='ad580d5687b249c789a394b23262b64a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Creating volume b933f7b7-fb95-4652-b96d-25068095d1a6 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:24:17 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b933f7b7-fb95-4652-b96d-25068095d1a6 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:17 devstack sudo[107931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b933f7b7-fb95-4652-b96d-25068095d1a6 1073741824
Nov 05 15:24:17 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Flow 'volume_create_manager' (1023e8fd-f47d-440d-b42e-5ed96d76a42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3396a82f-7217-4457-a9b1-6b34618fec9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3396a82f-7217-4457-a9b1-6b34618fec9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1548233326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89d06a1f-8945-4d77-bcc0-19161d345a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9e03f4a164bf48042da27edfd742d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:24:18Z,use_quota=True,user_id='d3585054b64542a1a174061b1731d371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e93c25-c728-42c5-a48e-22cd04c146c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e93c25-c728-42c5-a48e-22cd04c146c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9638ca76-bb01-449a-bbf2-f6cc9b125411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9638ca76-bb01-449a-bbf2-f6cc9b125411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89d06a1f-8945-4d77-bcc0-19161d345a64', 'volume_name': 'volume-89d06a1f-8945-4d77-bcc0-19161d345a64', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ca889e-07b2-4c41-9a94-612d60f0cdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ca889e-07b2-4c41-9a94-612d60f0cdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (880a0b75-38e3-4cc6-aab2-cde94ea4875a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:17 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Volume 89d06a1f-8945-4d77-bcc0-19161d345a64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89d06a1f-8945-4d77-bcc0-19161d345a64', 'volume_size': 1}
Nov 05 15:24:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:18 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b933f7b7-fb95-4652-b96d-25068095d1a6 1073741824" returned: 0 in 0.475s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b933f7b7-fb95-4652-b96d-25068095d1a6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:18 devstack sudo[107939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b933f7b7-fb95-4652-b96d-25068095d1a6
Nov 05 15:24:18 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:18 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b933f7b7-fb95-4652-b96d-25068095d1a6" returned: 0 in 0.236s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:24:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.442s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1548233326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89d06a1f-8945-4d77-bcc0-19161d345a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9e03f4a164bf48042da27edfd742d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:24:18Z,use_quota=True,user_id='d3585054b64542a1a174061b1731d371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:24:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Creating volume 89d06a1f-8945-4d77-bcc0-19161d345a64 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:24:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:24:18 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:24:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b55c66c-29da-44b0-9e15-51d27fb7e394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b933f7b7-fb95-4652-b96d-25068095d1a6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:18 devstack sudo[107942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64 1073741824
Nov 05 15:24:18 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b55e3b-cbc0-4c18-870c-2ad0a022d42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:18 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Volume volume-b933f7b7-fb95-4652-b96d-25068095d1a6 (b933f7b7-fb95-4652-b96d-25068095d1a6): created successfully
Nov 05 15:24:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b55e3b-cbc0-4c18-870c-2ad0a022d42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Flow 'volume_create_manager' (c808398f-132f-43bb-98e1-60d21ccaa3f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:24:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6456eef1-b2d6-4ec4-971c-123d52de6f76 tempest-ProjectReaderTests-877590865 None] Created volume successfully.
Nov 05 15:24:18 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64 1073741824" returned: 0 in 0.430s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:18 devstack sudo[107948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64
Nov 05 15:24:18 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:19 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64" returned: 0 in 0.238s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:24:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (880a0b75-38e3-4cc6-aab2-cde94ea4875a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89d06a1f-8945-4d77-bcc0-19161d345a64', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce63413d-4a2b-497a-bd25-6f6ab1a04ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:19 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Volume volume-89d06a1f-8945-4d77-bcc0-19161d345a64 (89d06a1f-8945-4d77-bcc0-19161d345a64): created successfully
Nov 05 15:24:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce63413d-4a2b-497a-bd25-6f6ab1a04ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Flow 'volume_create_manager' (1023e8fd-f47d-440d-b42e-5ed96d76a42a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:24:19 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-08a3fb15-742b-4f76-baa9-3ef65775218c tempest-ProjectMemberTests-340429542 None] Created volume successfully.
Nov 05 15:24:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f2a91a5d-c638-486f-bc45-fd0d02044513 tempest-ProjectReaderTests-877590865 None] Acquiring lock "cinder-b933f7b7-fb95-4652-b96d-25068095d1a6-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f2a91a5d-c638-486f-bc45-fd0d02044513 tempest-ProjectReaderTests-877590865 None] Lock "cinder-b933f7b7-fb95-4652-b96d-25068095d1a6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f2a91a5d-c638-486f-bc45-fd0d02044513 tempest-ProjectReaderTests-877590865 None] Acquiring lock "cinder-quobyte-b933f7b7-fb95-4652-b96d-25068095d1a6" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f2a91a5d-c638-486f-bc45-fd0d02044513 tempest-ProjectReaderTests-877590865 None] Lock "cinder-quobyte-b933f7b7-fb95-4652-b96d-25068095d1a6" acquired by "delete_volume" :: waited 0.013s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:19 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44b6cc7-d099-4548-8e1d-51d2f26c0d4f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f2a91a5d-c638-486f-bc45-fd0d02044513 tempest-ProjectReaderTests-877590865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b933f7b7-fb95-4652-b96d-25068095d1a6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:19 devstack sudo[107952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b933f7b7-fb95-4652-b96d-25068095d1a6
Nov 05 15:24:19 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d4583916-1d6a-4c70-b846-883cf1116e15 tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d4583916-1d6a-4c70-b846-883cf1116e15 tempest-ProjectMemberTests-340429542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-d4583916-1d6a-4c70-b846-883cf1116e15 tempest-ProjectMemberTests-340429542 None] Creating offline snapshot d9bd4b57-a9f1-4417-a68c-894c48f95f66 of volume 89d06a1f-8945-4d77-bcc0-19161d345a64 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:24:20 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9208110f-7cca-4ec0-b567-cfff7a989783]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4583916-1d6a-4c70-b846-883cf1116e15 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:20 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f2a91a5d-c638-486f-bc45-fd0d02044513 tempest-ProjectReaderTests-877590865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b933f7b7-fb95-4652-b96d-25068095d1a6" returned: 0 in 0.426s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f2a91a5d-c638-486f-bc45-fd0d02044513 tempest-ProjectReaderTests-877590865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b933f7b7-fb95-4652-b96d-25068095d1a6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:20 devstack sudo[107958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b933f7b7-fb95-4652-b96d-25068095d1a6
Nov 05 15:24:20 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:20 devstack sudo[107957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64
Nov 05 15:24:20 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:20 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f2a91a5d-c638-486f-bc45-fd0d02044513 tempest-ProjectReaderTests-877590865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-b933f7b7-fb95-4652-b96d-25068095d1a6" returned: 0 in 0.254s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f2a91a5d-c638-486f-bc45-fd0d02044513 tempest-ProjectReaderTests-877590865 None] Lock "cinder-quobyte-b933f7b7-fb95-4652-b96d-25068095d1a6" released by "delete_volume" :: held 0.720s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:20 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-f2a91a5d-c638-486f-bc45-fd0d02044513 tempest-ProjectReaderTests-877590865 None] Created reservations ['027a3e0e-ab9d-4247-8ffe-aa3cc4fa530f', '38ddd3cc-932d-4baf-b40c-bc0cf100817b', '9e92b75e-e949-4740-8173-32cdbfb87ddc', '932281ac-1c4e-49d3-975f-017656d43c74'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:24:20 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4583916-1d6a-4c70-b846-883cf1116e15 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64" returned: 0 in 0.377s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4583916-1d6a-4c70-b846-883cf1116e15 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.d9bd4b57-a9f1-4417-a68c-894c48f95f66 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:20 devstack sudo[107966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.d9bd4b57-a9f1-4417-a68c-894c48f95f66 1G
Nov 05 15:24:20 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f2a91a5d-c638-486f-bc45-fd0d02044513 tempest-ProjectReaderTests-877590865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f2a91a5d-c638-486f-bc45-fd0d02044513 tempest-ProjectReaderTests-877590865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f2a91a5d-c638-486f-bc45-fd0d02044513 tempest-ProjectReaderTests-877590865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f2a91a5d-c638-486f-bc45-fd0d02044513 tempest-ProjectReaderTests-877590865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f2a91a5d-c638-486f-bc45-fd0d02044513 tempest-ProjectReaderTests-877590865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f2a91a5d-c638-486f-bc45-fd0d02044513 tempest-ProjectReaderTests-877590865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:20 devstack sudo[107968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:24:20 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:20 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f2a91a5d-c638-486f-bc45-fd0d02044513 tempest-ProjectReaderTests-877590865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.254s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:20 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-f2a91a5d-c638-486f-bc45-fd0d02044513 tempest-ProjectReaderTests-877590865 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:24:20 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f2a91a5d-c638-486f-bc45-fd0d02044513 tempest-ProjectReaderTests-877590865 None] Deleted volume successfully.
Nov 05 15:24:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f2a91a5d-c638-486f-bc45-fd0d02044513 tempest-ProjectReaderTests-877590865 None] Lock "cinder-b933f7b7-fb95-4652-b96d-25068095d1a6-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:20 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4583916-1d6a-4c70-b846-883cf1116e15 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.d9bd4b57-a9f1-4417-a68c-894c48f95f66 1G" returned: 0 in 0.464s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4583916-1d6a-4c70-b846-883cf1116e15 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89d06a1f-8945-4d77-bcc0-19161d345a64 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.d9bd4b57-a9f1-4417-a68c-894c48f95f66 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:20 devstack sudo[107975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89d06a1f-8945-4d77-bcc0-19161d345a64 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.d9bd4b57-a9f1-4417-a68c-894c48f95f66
Nov 05 15:24:20 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:21 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4583916-1d6a-4c70-b846-883cf1116e15 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89d06a1f-8945-4d77-bcc0-19161d345a64 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.d9bd4b57-a9f1-4417-a68c-894c48f95f66" returned: 0 in 0.294s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:21 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-d4583916-1d6a-4c70-b846-883cf1116e15 tempest-ProjectMemberTests-340429542 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.d9bd4b57-a9f1-4417-a68c-894c48f95f66 is being set with open permissions: ugo+rw
Nov 05 15:24:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4583916-1d6a-4c70-b846-883cf1116e15 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.d9bd4b57-a9f1-4417-a68c-894c48f95f66 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:21 devstack sudo[107983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.d9bd4b57-a9f1-4417-a68c-894c48f95f66
Nov 05 15:24:21 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:21 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4583916-1d6a-4c70-b846-883cf1116e15 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.d9bd4b57-a9f1-4417-a68c-894c48f95f66" returned: 0 in 0.268s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4583916-1d6a-4c70-b846-883cf1116e15 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:21 devstack sudo[107992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.info
Nov 05 15:24:21 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:21 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4583916-1d6a-4c70-b846-883cf1116e15 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.info" returned: 0 in 0.275s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:21 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-d4583916-1d6a-4c70-b846-883cf1116e15 tempest-ProjectMemberTests-340429542 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.info is being set with open permissions: ugo+rw
Nov 05 15:24:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4583916-1d6a-4c70-b846-883cf1116e15 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:21 devstack sudo[107995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.info
Nov 05 15:24:21 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:22 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4583916-1d6a-4c70-b846-883cf1116e15 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.info" returned: 0 in 0.265s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d4583916-1d6a-4c70-b846-883cf1116e15 tempest-ProjectMemberTests-340429542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.042s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:22 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d4583916-1d6a-4c70-b846-883cf1116e15 tempest-ProjectMemberTests-340429542 None] Create snapshot completed successfully
Nov 05 15:24:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-702a9b66-2714-45a0-b22e-6c4a91a90d07 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-d9bd4b57-a9f1-4417-a68c-894c48f95f66-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-702a9b66-2714-45a0-b22e-6c4a91a90d07 tempest-ProjectMemberTests-340429542 None] Lock "cinder-d9bd4b57-a9f1-4417-a68c-894c48f95f66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-702a9b66-2714-45a0-b22e-6c4a91a90d07 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-89d06a1f-8945-4d77-bcc0-19161d345a64" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-702a9b66-2714-45a0-b22e-6c4a91a90d07 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-89d06a1f-8945-4d77-bcc0-19161d345a64" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-702a9b66-2714-45a0-b22e-6c4a91a90d07 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-d9bd4b57-a9f1-4417-a68c-894c48f95f66" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-702a9b66-2714-45a0-b22e-6c4a91a90d07 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-d9bd4b57-a9f1-4417-a68c-894c48f95f66" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-702a9b66-2714-45a0-b22e-6c4a91a90d07 tempest-ProjectMemberTests-340429542 None] Deleting offline snapshot d9bd4b57-a9f1-4417-a68c-894c48f95f66 of volume 89d06a1f-8945-4d77-bcc0-19161d345a64 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:24:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-702a9b66-2714-45a0-b22e-6c4a91a90d07 tempest-ProjectMemberTests-340429542 None] snapshot_file for this snap is: volume-89d06a1f-8945-4d77-bcc0-19161d345a64.d9bd4b57-a9f1-4417-a68c-894c48f95f66 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:24:23 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8032c6e8-abde-4746-9c8d-7e6629939165]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-702a9b66-2714-45a0-b22e-6c4a91a90d07 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.d9bd4b57-a9f1-4417-a68c-894c48f95f66 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:23 devstack sudo[107998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.d9bd4b57-a9f1-4417-a68c-894c48f95f66
Nov 05 15:24:23 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:23 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-702a9b66-2714-45a0-b22e-6c4a91a90d07 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.d9bd4b57-a9f1-4417-a68c-894c48f95f66" returned: 0 in 0.352s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-702a9b66-2714-45a0-b22e-6c4a91a90d07 tempest-ProjectMemberTests-340429542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89d06a1f-8945-4d77-bcc0-19161d345a64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:24:23 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3833bb14-66b4-428d-8073-bf6469bf3960]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-702a9b66-2714-45a0-b22e-6c4a91a90d07 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:23 devstack sudo[108003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64
Nov 05 15:24:23 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:24 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-702a9b66-2714-45a0-b22e-6c4a91a90d07 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64" returned: 0 in 0.346s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-702a9b66-2714-45a0-b22e-6c4a91a90d07 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.d9bd4b57-a9f1-4417-a68c-894c48f95f66 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:24 devstack sudo[108008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.d9bd4b57-a9f1-4417-a68c-894c48f95f66
Nov 05 15:24:24 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:24 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-702a9b66-2714-45a0-b22e-6c4a91a90d07 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.d9bd4b57-a9f1-4417-a68c-894c48f95f66" returned: 0 in 0.323s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-702a9b66-2714-45a0-b22e-6c4a91a90d07 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.d9bd4b57-a9f1-4417-a68c-894c48f95f66 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:24 devstack sudo[108013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.d9bd4b57-a9f1-4417-a68c-894c48f95f66
Nov 05 15:24:24 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:24 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-702a9b66-2714-45a0-b22e-6c4a91a90d07 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64.d9bd4b57-a9f1-4417-a68c-894c48f95f66" returned: 0 in 0.245s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-702a9b66-2714-45a0-b22e-6c4a91a90d07 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-d9bd4b57-a9f1-4417-a68c-894c48f95f66" released by "_delete_snapshot" :: held 1.360s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-702a9b66-2714-45a0-b22e-6c4a91a90d07 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-89d06a1f-8945-4d77-bcc0-19161d345a64" released by "delete_snapshot" :: held 1.380s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:24 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-702a9b66-2714-45a0-b22e-6c4a91a90d07 tempest-ProjectMemberTests-340429542 None] Created reservations ['df0ff8a6-18c3-46d7-8d16-423ff5996cde', 'ad4caae3-b974-4510-85ba-f0a7750043c2', 'e363bfc3-0f21-465b-8939-145edd4cfae9', '8fe5b928-651b-406e-9082-5bd2e8709596'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:24:24 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-702a9b66-2714-45a0-b22e-6c4a91a90d07 tempest-ProjectMemberTests-340429542 None] Delete snapshot completed successfully.
Nov 05 15:24:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-702a9b66-2714-45a0-b22e-6c4a91a90d07 tempest-ProjectMemberTests-340429542 None] Lock "cinder-d9bd4b57-a9f1-4417-a68c-894c48f95f66-delete_snapshot" released by "delete_snapshot" :: held 1.507s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d29c6226-90f8-4e90-bac7-34b27b64ecd4 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-89d06a1f-8945-4d77-bcc0-19161d345a64-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d29c6226-90f8-4e90-bac7-34b27b64ecd4 tempest-ProjectMemberTests-340429542 None] Lock "cinder-89d06a1f-8945-4d77-bcc0-19161d345a64-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d29c6226-90f8-4e90-bac7-34b27b64ecd4 tempest-ProjectMemberTests-340429542 None] Acquiring lock "cinder-quobyte-89d06a1f-8945-4d77-bcc0-19161d345a64" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d29c6226-90f8-4e90-bac7-34b27b64ecd4 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-89d06a1f-8945-4d77-bcc0-19161d345a64" acquired by "delete_volume" :: waited 0.013s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:25 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[349553b3-6bbd-46c4-b546-cf0f1ed97c16]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d29c6226-90f8-4e90-bac7-34b27b64ecd4 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:25 devstack sudo[108016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64
Nov 05 15:24:25 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:25 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d29c6226-90f8-4e90-bac7-34b27b64ecd4 tempest-ProjectMemberTests-340429542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64" returned: 0 in 0.366s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d29c6226-90f8-4e90-bac7-34b27b64ecd4 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:25 devstack sudo[108021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64
Nov 05 15:24:25 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:26 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d29c6226-90f8-4e90-bac7-34b27b64ecd4 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-89d06a1f-8945-4d77-bcc0-19161d345a64" returned: 0 in 0.240s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d29c6226-90f8-4e90-bac7-34b27b64ecd4 tempest-ProjectMemberTests-340429542 None] Lock "cinder-quobyte-89d06a1f-8945-4d77-bcc0-19161d345a64" released by "delete_volume" :: held 0.665s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:26 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-d29c6226-90f8-4e90-bac7-34b27b64ecd4 tempest-ProjectMemberTests-340429542 None] Created reservations ['517f08ef-8992-4567-89d2-6549cf182a26', 'eec66429-f401-4a4d-8aec-e1a03d7c342b', '6d53dca0-0a62-44c1-85f4-433b8ae2e9d2', 'a22f41b2-147d-45eb-b50c-2f71cd412d4a'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:24:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d29c6226-90f8-4e90-bac7-34b27b64ecd4 tempest-ProjectMemberTests-340429542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d29c6226-90f8-4e90-bac7-34b27b64ecd4 tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d29c6226-90f8-4e90-bac7-34b27b64ecd4 tempest-ProjectMemberTests-340429542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d29c6226-90f8-4e90-bac7-34b27b64ecd4 tempest-ProjectMemberTests-340429542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d29c6226-90f8-4e90-bac7-34b27b64ecd4 tempest-ProjectMemberTests-340429542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d29c6226-90f8-4e90-bac7-34b27b64ecd4 tempest-ProjectMemberTests-340429542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:26 devstack sudo[108024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:24:26 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:26 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d29c6226-90f8-4e90-bac7-34b27b64ecd4 tempest-ProjectMemberTests-340429542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.266s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:26 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-d29c6226-90f8-4e90-bac7-34b27b64ecd4 tempest-ProjectMemberTests-340429542 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:24:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d29c6226-90f8-4e90-bac7-34b27b64ecd4 tempest-ProjectMemberTests-340429542 None] Deleted volume successfully.
Nov 05 15:24:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d29c6226-90f8-4e90-bac7-34b27b64ecd4 tempest-ProjectMemberTests-340429542 None] Lock "cinder-89d06a1f-8945-4d77-bcc0-19161d345a64-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:29 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:24:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Flow 'volume_create_manager' (ed67997d-a532-4652-8aa7-2615a67758e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:24:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e193c6ad-ab94-4e45-bb66-267838c3e6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e193c6ad-ab94-4e45-bb66-267838c3e6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1727870807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1146a09-e891-4b74-83f3-fba274c6a4dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0310c9a825344e0a4b8b5ff9eb39ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:24:30Z,use_quota=True,user_id='66aaa5bcdee04fa2a9af482320d258f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b6b7a0-ab07-440c-81db-20836698a390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b6b7a0-ab07-440c-81db-20836698a390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c82f2a3a-2c39-44f9-858a-e32eedb159a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c82f2a3a-2c39-44f9-858a-e32eedb159a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1146a09-e891-4b74-83f3-fba274c6a4dc', 'volume_name': 'volume-c1146a09-e891-4b74-83f3-fba274c6a4dc', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b650bb8f-bab6-4c17-ab81-eac9cad79132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b650bb8f-bab6-4c17-ab81-eac9cad79132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ab224e-d154-4d19-8ab5-ef2994223325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:30 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Volume c1146a09-e891-4b74-83f3-fba274c6a4dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1146a09-e891-4b74-83f3-fba274c6a4dc', 'volume_size': 1}
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1727870807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1146a09-e891-4b74-83f3-fba274c6a4dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0310c9a825344e0a4b8b5ff9eb39ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:24:30Z,use_quota=True,user_id='66aaa5bcdee04fa2a9af482320d258f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Creating volume c1146a09-e891-4b74-83f3-fba274c6a4dc {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:24:30 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:30 devstack sudo[108064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc 1073741824
Nov 05 15:24:30 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:30 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc 1073741824" returned: 0 in 0.399s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:30 devstack sudo[108070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc
Nov 05 15:24:30 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:30 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc" returned: 0 in 0.238s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ab224e-d154-4d19-8ab5-ef2994223325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1146a09-e891-4b74-83f3-fba274c6a4dc', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa2bf3c-2712-4733-9293-798142080152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:30 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Volume volume-c1146a09-e891-4b74-83f3-fba274c6a4dc (c1146a09-e891-4b74-83f3-fba274c6a4dc): created successfully
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa2bf3c-2712-4733-9293-798142080152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Flow 'volume_create_manager' (ed67997d-a532-4652-8aa7-2615a67758e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:24:30 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3a0e0ba3-ad11-45ff-811b-b9d2a3916aec tempest-ProjectReaderTests-1286815890 None] Created volume successfully.
Nov 05 15:24:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-898cbf4d-ff1f-4eb8-bac2-364c7a03698a tempest-ProjectReaderTests-1286815890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-898cbf4d-ff1f-4eb8-bac2-364c7a03698a tempest-ProjectReaderTests-1286815890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-898cbf4d-ff1f-4eb8-bac2-364c7a03698a tempest-ProjectReaderTests-1286815890 None] Creating offline snapshot f1dda11b-091c-4079-8d59-e1b877ec98a7 of volume c1146a09-e891-4b74-83f3-fba274c6a4dc {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:24:31 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbb657a-d142-4b6a-a4dc-008936e90bec]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-898cbf4d-ff1f-4eb8-bac2-364c7a03698a tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:31 devstack sudo[108073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc
Nov 05 15:24:31 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:31 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-898cbf4d-ff1f-4eb8-bac2-364c7a03698a tempest-ProjectReaderTests-1286815890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc" returned: 0 in 0.358s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-898cbf4d-ff1f-4eb8-bac2-364c7a03698a tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.f1dda11b-091c-4079-8d59-e1b877ec98a7 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:31 devstack sudo[108078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.f1dda11b-091c-4079-8d59-e1b877ec98a7 1G
Nov 05 15:24:31 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:31 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-898cbf4d-ff1f-4eb8-bac2-364c7a03698a tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.f1dda11b-091c-4079-8d59-e1b877ec98a7 1G" returned: 0 in 0.386s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-898cbf4d-ff1f-4eb8-bac2-364c7a03698a tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1146a09-e891-4b74-83f3-fba274c6a4dc -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.f1dda11b-091c-4079-8d59-e1b877ec98a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:31 devstack sudo[108083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1146a09-e891-4b74-83f3-fba274c6a4dc -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.f1dda11b-091c-4079-8d59-e1b877ec98a7
Nov 05 15:24:31 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:32 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-898cbf4d-ff1f-4eb8-bac2-364c7a03698a tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1146a09-e891-4b74-83f3-fba274c6a4dc -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.f1dda11b-091c-4079-8d59-e1b877ec98a7" returned: 0 in 0.296s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:32 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-898cbf4d-ff1f-4eb8-bac2-364c7a03698a tempest-ProjectReaderTests-1286815890 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.f1dda11b-091c-4079-8d59-e1b877ec98a7 is being set with open permissions: ugo+rw
Nov 05 15:24:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-898cbf4d-ff1f-4eb8-bac2-364c7a03698a tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.f1dda11b-091c-4079-8d59-e1b877ec98a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:32 devstack sudo[108088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.f1dda11b-091c-4079-8d59-e1b877ec98a7
Nov 05 15:24:32 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:32 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-898cbf4d-ff1f-4eb8-bac2-364c7a03698a tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.f1dda11b-091c-4079-8d59-e1b877ec98a7" returned: 0 in 0.238s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-898cbf4d-ff1f-4eb8-bac2-364c7a03698a tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:32 devstack sudo[108091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.info
Nov 05 15:24:32 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:32 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-898cbf4d-ff1f-4eb8-bac2-364c7a03698a tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.info" returned: 0 in 0.246s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:32 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-898cbf4d-ff1f-4eb8-bac2-364c7a03698a tempest-ProjectReaderTests-1286815890 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.info is being set with open permissions: ugo+rw
Nov 05 15:24:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-898cbf4d-ff1f-4eb8-bac2-364c7a03698a tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:32 devstack sudo[108094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.info
Nov 05 15:24:32 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:32 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-898cbf4d-ff1f-4eb8-bac2-364c7a03698a tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.info" returned: 0 in 0.237s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-898cbf4d-ff1f-4eb8-bac2-364c7a03698a tempest-ProjectReaderTests-1286815890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.840s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:33 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-898cbf4d-ff1f-4eb8-bac2-364c7a03698a tempest-ProjectReaderTests-1286815890 None] Create snapshot completed successfully
Nov 05 15:24:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-68eb0abd-5573-4592-9c38-f97a7cbba6e6 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-f1dda11b-091c-4079-8d59-e1b877ec98a7-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-68eb0abd-5573-4592-9c38-f97a7cbba6e6 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-f1dda11b-091c-4079-8d59-e1b877ec98a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-68eb0abd-5573-4592-9c38-f97a7cbba6e6 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-quobyte-c1146a09-e891-4b74-83f3-fba274c6a4dc" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-68eb0abd-5573-4592-9c38-f97a7cbba6e6 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-c1146a09-e891-4b74-83f3-fba274c6a4dc" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-68eb0abd-5573-4592-9c38-f97a7cbba6e6 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-quobyte-f1dda11b-091c-4079-8d59-e1b877ec98a7" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-68eb0abd-5573-4592-9c38-f97a7cbba6e6 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-f1dda11b-091c-4079-8d59-e1b877ec98a7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-68eb0abd-5573-4592-9c38-f97a7cbba6e6 tempest-ProjectReaderTests-1286815890 None] Deleting offline snapshot f1dda11b-091c-4079-8d59-e1b877ec98a7 of volume c1146a09-e891-4b74-83f3-fba274c6a4dc {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:24:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-68eb0abd-5573-4592-9c38-f97a7cbba6e6 tempest-ProjectReaderTests-1286815890 None] snapshot_file for this snap is: volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.f1dda11b-091c-4079-8d59-e1b877ec98a7 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:24:33 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e283d9-be2a-45ad-bc16-38f621c954d7]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-68eb0abd-5573-4592-9c38-f97a7cbba6e6 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.f1dda11b-091c-4079-8d59-e1b877ec98a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:33 devstack sudo[108097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.f1dda11b-091c-4079-8d59-e1b877ec98a7
Nov 05 15:24:33 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:33 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-68eb0abd-5573-4592-9c38-f97a7cbba6e6 tempest-ProjectReaderTests-1286815890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.f1dda11b-091c-4079-8d59-e1b877ec98a7" returned: 0 in 0.353s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-68eb0abd-5573-4592-9c38-f97a7cbba6e6 tempest-ProjectReaderTests-1286815890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1146a09-e891-4b74-83f3-fba274c6a4dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:24:33 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[01119e3d-db12-4695-97bd-8fd40a45674f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-68eb0abd-5573-4592-9c38-f97a7cbba6e6 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:33 devstack sudo[108102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc
Nov 05 15:24:33 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:34 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-68eb0abd-5573-4592-9c38-f97a7cbba6e6 tempest-ProjectReaderTests-1286815890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc" returned: 0 in 0.343s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-68eb0abd-5573-4592-9c38-f97a7cbba6e6 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.f1dda11b-091c-4079-8d59-e1b877ec98a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:34 devstack sudo[108107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.f1dda11b-091c-4079-8d59-e1b877ec98a7
Nov 05 15:24:34 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:34 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-68eb0abd-5573-4592-9c38-f97a7cbba6e6 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.f1dda11b-091c-4079-8d59-e1b877ec98a7" returned: 0 in 0.323s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-68eb0abd-5573-4592-9c38-f97a7cbba6e6 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.f1dda11b-091c-4079-8d59-e1b877ec98a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:34 devstack sudo[108113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.f1dda11b-091c-4079-8d59-e1b877ec98a7
Nov 05 15:24:34 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:34 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-68eb0abd-5573-4592-9c38-f97a7cbba6e6 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc.f1dda11b-091c-4079-8d59-e1b877ec98a7" returned: 0 in 0.240s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-68eb0abd-5573-4592-9c38-f97a7cbba6e6 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-f1dda11b-091c-4079-8d59-e1b877ec98a7" released by "_delete_snapshot" :: held 1.362s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-68eb0abd-5573-4592-9c38-f97a7cbba6e6 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-c1146a09-e891-4b74-83f3-fba274c6a4dc" released by "delete_snapshot" :: held 1.384s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:34 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-68eb0abd-5573-4592-9c38-f97a7cbba6e6 tempest-ProjectReaderTests-1286815890 None] Created reservations ['9cdc7ab8-7b7d-4f17-b60c-13c53bcbc12e', 'fc4337d1-9ac5-4d47-b159-32035bd993b7', 'e4b64300-4111-4c5f-a080-8daea52196c6', '11ce2c77-fb79-4d42-a3d3-9d98083626cc'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:24:34 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-68eb0abd-5573-4592-9c38-f97a7cbba6e6 tempest-ProjectReaderTests-1286815890 None] Delete snapshot completed successfully.
Nov 05 15:24:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-68eb0abd-5573-4592-9c38-f97a7cbba6e6 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-f1dda11b-091c-4079-8d59-e1b877ec98a7-delete_snapshot" released by "delete_snapshot" :: held 1.519s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-730c720d-07fe-498a-a89e-a7c7399ffa0d tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-c1146a09-e891-4b74-83f3-fba274c6a4dc-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-730c720d-07fe-498a-a89e-a7c7399ffa0d tempest-ProjectReaderTests-1286815890 None] Lock "cinder-c1146a09-e891-4b74-83f3-fba274c6a4dc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-730c720d-07fe-498a-a89e-a7c7399ffa0d tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-quobyte-c1146a09-e891-4b74-83f3-fba274c6a4dc" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-730c720d-07fe-498a-a89e-a7c7399ffa0d tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-c1146a09-e891-4b74-83f3-fba274c6a4dc" acquired by "delete_volume" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:35 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50135dd-c3ae-4598-8a01-b2cd0f05fbd1]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-730c720d-07fe-498a-a89e-a7c7399ffa0d tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:35 devstack sudo[108116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc
Nov 05 15:24:35 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:36 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-730c720d-07fe-498a-a89e-a7c7399ffa0d tempest-ProjectReaderTests-1286815890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc" returned: 0 in 0.349s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-730c720d-07fe-498a-a89e-a7c7399ffa0d tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:36 devstack sudo[108121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc
Nov 05 15:24:36 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:36 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-730c720d-07fe-498a-a89e-a7c7399ffa0d tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-c1146a09-e891-4b74-83f3-fba274c6a4dc" returned: 0 in 0.243s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-730c720d-07fe-498a-a89e-a7c7399ffa0d tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-c1146a09-e891-4b74-83f3-fba274c6a4dc" released by "delete_volume" :: held 0.649s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:36 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-730c720d-07fe-498a-a89e-a7c7399ffa0d tempest-ProjectReaderTests-1286815890 None] Created reservations ['a9e6ff5c-5113-427f-80f6-bf797ea4afcd', '87b40fe1-b2f9-460b-869a-43af574b5f82', '35a6883f-825b-4d70-8937-cb888f5fba2a', 'd823984a-15b6-41f9-b476-6cb985ad0e4c'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:24:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-730c720d-07fe-498a-a89e-a7c7399ffa0d tempest-ProjectReaderTests-1286815890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-730c720d-07fe-498a-a89e-a7c7399ffa0d tempest-ProjectReaderTests-1286815890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-730c720d-07fe-498a-a89e-a7c7399ffa0d tempest-ProjectReaderTests-1286815890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-730c720d-07fe-498a-a89e-a7c7399ffa0d tempest-ProjectReaderTests-1286815890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-730c720d-07fe-498a-a89e-a7c7399ffa0d tempest-ProjectReaderTests-1286815890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-730c720d-07fe-498a-a89e-a7c7399ffa0d tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:36 devstack sudo[108124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:24:36 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:36 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-730c720d-07fe-498a-a89e-a7c7399ffa0d tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.239s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:36 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-730c720d-07fe-498a-a89e-a7c7399ffa0d tempest-ProjectReaderTests-1286815890 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:24:36 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-730c720d-07fe-498a-a89e-a7c7399ffa0d tempest-ProjectReaderTests-1286815890 None] Deleted volume successfully.
Nov 05 15:24:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-730c720d-07fe-498a-a89e-a7c7399ffa0d tempest-ProjectReaderTests-1286815890 None] Lock "cinder-c1146a09-e891-4b74-83f3-fba274c6a4dc-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Flow 'volume_create_manager' (f0c4beb4-82a8-4257-9133-026e223616e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9ef1f8-712f-4a61-8a62-8fbdef6f3729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9ef1f8-712f-4a61-8a62-8fbdef6f3729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-284427375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb81f631-6a6e-4954-9a4c-514b7faaebcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0310c9a825344e0a4b8b5ff9eb39ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:24:37Z,use_quota=True,user_id='66aaa5bcdee04fa2a9af482320d258f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c738d497-a02d-453a-88fe-24be3e73e5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c738d497-a02d-453a-88fe-24be3e73e5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16561858-9bbf-4112-ae5a-9660924bcad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16561858-9bbf-4112-ae5a-9660924bcad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb81f631-6a6e-4954-9a4c-514b7faaebcd', 'volume_name': 'volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04e330c-146b-464d-9319-8ba9709175da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04e330c-146b-464d-9319-8ba9709175da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f8225e3-26e6-46aa-b575-d0f32271bc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:37 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Volume cb81f631-6a6e-4954-9a4c-514b7faaebcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd', 'volume_size': 1}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-284427375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb81f631-6a6e-4954-9a4c-514b7faaebcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0310c9a825344e0a4b8b5ff9eb39ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:24:37Z,use_quota=True,user_id='66aaa5bcdee04fa2a9af482320d258f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Creating volume cb81f631-6a6e-4954-9a4c-514b7faaebcd {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:24:37 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:37 devstack sudo[108127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd 1073741824
Nov 05 15:24:37 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:37 devstack sudo[108129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:24:37 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:37 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.244s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread info: [<_MainThread(MainThread, started 136317437956224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136317326340928)>, <Thread(Thread-3 (stat_writer), started daemon 136317326487936)>, <Thread(Rabbit-heartbeat, started daemon 136317321464000)>, <Thread(Thread-5 (_runner), started daemon 136317321550592)>, <Thread(Thread-7 (_runner), started daemon 136317321658496)>, <Thread(fd_logger, started daemon 136317319612992)>, <Thread(privsep_reader, started daemon 136317319622400)>, <Thread(tpool_thread_0, started daemon 136317310928576)>, <Thread(tpool_thread_1, started daemon 136317302535872)>, <Thread(tpool_thread_2, started daemon 136317294143168)>, <Thread(tpool_thread_3, started daemon 136317285750464)>, <Thread(tpool_thread_4, started daemon 136317277357760)>, <Thread(tpool_thread_5, started daemon 136317268965056)>, <Thread(tpool_thread_6, started daemon 136317260572352)>, <Thread(tpool_thread_7, started daemon 136317252179648)>, <Thread(tpool_thread_8, started daemon 136317243786944)>, <Thread(tpool_thread_9, started daemon 136317235394240)>, <Thread(tpool_thread_10, started daemon 136317227001536)>, <Thread(tpool_thread_11, started daemon 136317218608832)>, <Thread(tpool_thread_12, started daemon 136317210216128)>, <Thread(tpool_thread_13, started daemon 136317201807040)>, <Thread(tpool_thread_14, started daemon 136317193397952)>, <Thread(tpool_thread_15, started daemon 136317184988864)>, <Thread(tpool_thread_16, started daemon 136317176579776)>, <Thread(tpool_thread_17, started daemon 136317168170688)>, <Thread(tpool_thread_18, started daemon 136317159761600)>, <Thread(tpool_thread_19, started daemon 136317151352512)>] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 15:24:37 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd 1073741824" returned: 0 in 0.422s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:37 devstack sudo[108136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd
Nov 05 15:24:37 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:38 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd" returned: 0 in 0.245s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:24:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:38 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=206,cinder:DELETE=18,cinder:SELECT=154,cinder:INSERT=63 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:24:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f8225e3-26e6-46aa-b575-d0f32271bc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d9685d-db85-4a25-951e-94e4ae14f269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:38 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=156,cinder:UPDATE=220,cinder:INSERT=49,cinder:DELETE=16 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:24:38 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Volume volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd (cb81f631-6a6e-4954-9a4c-514b7faaebcd): created successfully
Nov 05 15:24:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d9685d-db85-4a25-951e-94e4ae14f269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Flow 'volume_create_manager' (f0c4beb4-82a8-4257-9133-026e223616e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:24:38 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-cf70db8d-c8a5-44ba-8447-72ee35f57fa7 tempest-ProjectReaderTests-1286815890 None] Created volume successfully.
Nov 05 15:24:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3237b969-f920-41ad-b927-43988a545fea tempest-ProjectReaderTests-1286815890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3237b969-f920-41ad-b927-43988a545fea tempest-ProjectReaderTests-1286815890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-3237b969-f920-41ad-b927-43988a545fea tempest-ProjectReaderTests-1286815890 None] Creating offline snapshot 969ee88c-4879-479f-9b85-3880ebd91fce of volume cb81f631-6a6e-4954-9a4c-514b7faaebcd {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:24:38 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bee769-ea91-4ddb-8c54-2482f434a80b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3237b969-f920-41ad-b927-43988a545fea tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:38 devstack sudo[108139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd
Nov 05 15:24:38 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:38 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3237b969-f920-41ad-b927-43988a545fea tempest-ProjectReaderTests-1286815890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd" returned: 0 in 0.361s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3237b969-f920-41ad-b927-43988a545fea tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.969ee88c-4879-479f-9b85-3880ebd91fce 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:38 devstack sudo[108144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.969ee88c-4879-479f-9b85-3880ebd91fce 1G
Nov 05 15:24:38 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:39 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3237b969-f920-41ad-b927-43988a545fea tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.969ee88c-4879-479f-9b85-3880ebd91fce 1G" returned: 0 in 0.381s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3237b969-f920-41ad-b927-43988a545fea tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.969ee88c-4879-479f-9b85-3880ebd91fce {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:39 devstack sudo[108149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.969ee88c-4879-479f-9b85-3880ebd91fce
Nov 05 15:24:39 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:39 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3237b969-f920-41ad-b927-43988a545fea tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.969ee88c-4879-479f-9b85-3880ebd91fce" returned: 0 in 0.307s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:39 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-3237b969-f920-41ad-b927-43988a545fea tempest-ProjectReaderTests-1286815890 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.969ee88c-4879-479f-9b85-3880ebd91fce is being set with open permissions: ugo+rw
Nov 05 15:24:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3237b969-f920-41ad-b927-43988a545fea tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.969ee88c-4879-479f-9b85-3880ebd91fce {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:39 devstack sudo[108155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.969ee88c-4879-479f-9b85-3880ebd91fce
Nov 05 15:24:39 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:39 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3237b969-f920-41ad-b927-43988a545fea tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.969ee88c-4879-479f-9b85-3880ebd91fce" returned: 0 in 0.255s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3237b969-f920-41ad-b927-43988a545fea tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:39 devstack sudo[108159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.info
Nov 05 15:24:39 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:39 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3237b969-f920-41ad-b927-43988a545fea tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.info" returned: 0 in 0.253s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:39 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-3237b969-f920-41ad-b927-43988a545fea tempest-ProjectReaderTests-1286815890 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.info is being set with open permissions: ugo+rw
Nov 05 15:24:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3237b969-f920-41ad-b927-43988a545fea tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:39 devstack sudo[108162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.info
Nov 05 15:24:39 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:40 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3237b969-f920-41ad-b927-43988a545fea tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.info" returned: 0 in 0.239s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3237b969-f920-41ad-b927-43988a545fea tempest-ProjectReaderTests-1286815890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.876s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:40 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3237b969-f920-41ad-b927-43988a545fea tempest-ProjectReaderTests-1286815890 None] Create snapshot completed successfully
Nov 05 15:24:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0342a1f6-83b1-42d1-abc3-d38378d2d9f8 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-969ee88c-4879-479f-9b85-3880ebd91fce-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0342a1f6-83b1-42d1-abc3-d38378d2d9f8 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-969ee88c-4879-479f-9b85-3880ebd91fce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0342a1f6-83b1-42d1-abc3-d38378d2d9f8 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-quobyte-cb81f631-6a6e-4954-9a4c-514b7faaebcd" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0342a1f6-83b1-42d1-abc3-d38378d2d9f8 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-cb81f631-6a6e-4954-9a4c-514b7faaebcd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0342a1f6-83b1-42d1-abc3-d38378d2d9f8 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-quobyte-969ee88c-4879-479f-9b85-3880ebd91fce" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0342a1f6-83b1-42d1-abc3-d38378d2d9f8 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-969ee88c-4879-479f-9b85-3880ebd91fce" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-0342a1f6-83b1-42d1-abc3-d38378d2d9f8 tempest-ProjectReaderTests-1286815890 None] Deleting offline snapshot 969ee88c-4879-479f-9b85-3880ebd91fce of volume cb81f631-6a6e-4954-9a4c-514b7faaebcd {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:24:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-0342a1f6-83b1-42d1-abc3-d38378d2d9f8 tempest-ProjectReaderTests-1286815890 None] snapshot_file for this snap is: volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.969ee88c-4879-479f-9b85-3880ebd91fce {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:24:40 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fba50e-dc83-4c84-8b1b-46533dc24e0b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0342a1f6-83b1-42d1-abc3-d38378d2d9f8 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.969ee88c-4879-479f-9b85-3880ebd91fce {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:40 devstack sudo[108165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.969ee88c-4879-479f-9b85-3880ebd91fce
Nov 05 15:24:40 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:40 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0342a1f6-83b1-42d1-abc3-d38378d2d9f8 tempest-ProjectReaderTests-1286815890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.969ee88c-4879-479f-9b85-3880ebd91fce" returned: 0 in 0.360s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-0342a1f6-83b1-42d1-abc3-d38378d2d9f8 tempest-ProjectReaderTests-1286815890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:24:40 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab88711-53cc-4852-bc57-2e44c5cbcef1]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0342a1f6-83b1-42d1-abc3-d38378d2d9f8 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:41 devstack sudo[108170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd
Nov 05 15:24:41 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:41 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0342a1f6-83b1-42d1-abc3-d38378d2d9f8 tempest-ProjectReaderTests-1286815890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd" returned: 0 in 0.353s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0342a1f6-83b1-42d1-abc3-d38378d2d9f8 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.969ee88c-4879-479f-9b85-3880ebd91fce {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:41 devstack sudo[108175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.969ee88c-4879-479f-9b85-3880ebd91fce
Nov 05 15:24:41 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:41 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0342a1f6-83b1-42d1-abc3-d38378d2d9f8 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.969ee88c-4879-479f-9b85-3880ebd91fce" returned: 0 in 0.340s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0342a1f6-83b1-42d1-abc3-d38378d2d9f8 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.969ee88c-4879-479f-9b85-3880ebd91fce {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:41 devstack sudo[108180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.969ee88c-4879-479f-9b85-3880ebd91fce
Nov 05 15:24:41 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:41 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0342a1f6-83b1-42d1-abc3-d38378d2d9f8 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd.969ee88c-4879-479f-9b85-3880ebd91fce" returned: 0 in 0.256s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0342a1f6-83b1-42d1-abc3-d38378d2d9f8 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-969ee88c-4879-479f-9b85-3880ebd91fce" released by "_delete_snapshot" :: held 1.406s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0342a1f6-83b1-42d1-abc3-d38378d2d9f8 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-cb81f631-6a6e-4954-9a4c-514b7faaebcd" released by "delete_snapshot" :: held 1.428s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:41 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-0342a1f6-83b1-42d1-abc3-d38378d2d9f8 tempest-ProjectReaderTests-1286815890 None] Created reservations ['ffbd6713-585c-40b2-aeea-6f4209f0ef63', 'd4f8bb1a-b8cf-45c8-84f9-76950f6f4d9f', '7c1034ce-89e8-4b27-a1b9-86b6d1111a58', '5d045a7f-633a-4c5f-8892-ea1111ffca9e'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:24:42 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0342a1f6-83b1-42d1-abc3-d38378d2d9f8 tempest-ProjectReaderTests-1286815890 None] Delete snapshot completed successfully.
Nov 05 15:24:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0342a1f6-83b1-42d1-abc3-d38378d2d9f8 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-969ee88c-4879-479f-9b85-3880ebd91fce-delete_snapshot" released by "delete_snapshot" :: held 1.552s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-38a6aefb-c667-478b-ac27-496e02e6197a tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-cb81f631-6a6e-4954-9a4c-514b7faaebcd-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-38a6aefb-c667-478b-ac27-496e02e6197a tempest-ProjectReaderTests-1286815890 None] Lock "cinder-cb81f631-6a6e-4954-9a4c-514b7faaebcd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-38a6aefb-c667-478b-ac27-496e02e6197a tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-quobyte-cb81f631-6a6e-4954-9a4c-514b7faaebcd" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-38a6aefb-c667-478b-ac27-496e02e6197a tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-cb81f631-6a6e-4954-9a4c-514b7faaebcd" acquired by "delete_volume" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:42 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63f16c4-d4ea-4e87-920a-9d4ab4fe757a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-38a6aefb-c667-478b-ac27-496e02e6197a tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:42 devstack sudo[108183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd
Nov 05 15:24:42 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:43 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-38a6aefb-c667-478b-ac27-496e02e6197a tempest-ProjectReaderTests-1286815890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd" returned: 0 in 0.353s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-38a6aefb-c667-478b-ac27-496e02e6197a tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:43 devstack sudo[108188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd
Nov 05 15:24:43 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:43 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-38a6aefb-c667-478b-ac27-496e02e6197a tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cb81f631-6a6e-4954-9a4c-514b7faaebcd" returned: 0 in 0.240s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-38a6aefb-c667-478b-ac27-496e02e6197a tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-cb81f631-6a6e-4954-9a4c-514b7faaebcd" released by "delete_volume" :: held 0.654s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:43 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-38a6aefb-c667-478b-ac27-496e02e6197a tempest-ProjectReaderTests-1286815890 None] Created reservations ['0a90a640-29c6-46a6-8468-81eea0ab7084', 'cfe2d202-6b03-435e-8384-b86c3ff7a987', 'ab4fc86e-cba4-4150-8023-9f39a7310b4c', '0d0e1921-1e01-47a7-88f2-9d08629568da'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:24:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-38a6aefb-c667-478b-ac27-496e02e6197a tempest-ProjectReaderTests-1286815890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-38a6aefb-c667-478b-ac27-496e02e6197a tempest-ProjectReaderTests-1286815890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-38a6aefb-c667-478b-ac27-496e02e6197a tempest-ProjectReaderTests-1286815890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-38a6aefb-c667-478b-ac27-496e02e6197a tempest-ProjectReaderTests-1286815890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-38a6aefb-c667-478b-ac27-496e02e6197a tempest-ProjectReaderTests-1286815890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-38a6aefb-c667-478b-ac27-496e02e6197a tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:43 devstack sudo[108191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:24:43 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:43 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-38a6aefb-c667-478b-ac27-496e02e6197a tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.251s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:43 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-38a6aefb-c667-478b-ac27-496e02e6197a tempest-ProjectReaderTests-1286815890 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:24:43 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-38a6aefb-c667-478b-ac27-496e02e6197a tempest-ProjectReaderTests-1286815890 None] Deleted volume successfully.
Nov 05 15:24:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-38a6aefb-c667-478b-ac27-496e02e6197a tempest-ProjectReaderTests-1286815890 None] Lock "cinder-cb81f631-6a6e-4954-9a4c-514b7faaebcd-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Flow 'volume_create_manager' (4c47e511-8a7a-4988-af19-8303d50d0a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e95c8b2-a1e4-4c8c-9dfc-104c9d9f9994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e95c8b2-a1e4-4c8c-9dfc-104c9d9f9994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-259478383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5723d3-374b-4bcb-a1b2-c19a09798d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0310c9a825344e0a4b8b5ff9eb39ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:24:44Z,use_quota=True,user_id='66aaa5bcdee04fa2a9af482320d258f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0130fef4-8523-4d9a-9dc3-0317780fe78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0130fef4-8523-4d9a-9dc3-0317780fe78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824e18ed-f235-4082-ad9d-ebd64d583cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824e18ed-f235-4082-ad9d-ebd64d583cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c5723d3-374b-4bcb-a1b2-c19a09798d5a', 'volume_name': 'volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029322a0-446b-49ca-bd6b-4051c52ba7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029322a0-446b-49ca-bd6b-4051c52ba7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e54a0fc-004e-43c6-b517-d798c49d7859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:44 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Volume 6c5723d3-374b-4bcb-a1b2-c19a09798d5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a', 'volume_size': 1}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-259478383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5723d3-374b-4bcb-a1b2-c19a09798d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0310c9a825344e0a4b8b5ff9eb39ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:24:44Z,use_quota=True,user_id='66aaa5bcdee04fa2a9af482320d258f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Creating volume 6c5723d3-374b-4bcb-a1b2-c19a09798d5a {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:24:44 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:44 devstack sudo[108194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a 1073741824
Nov 05 15:24:44 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:44 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a 1073741824" returned: 0 in 0.410s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:44 devstack sudo[108199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a
Nov 05 15:24:44 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:44 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a" returned: 0 in 0.240s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e54a0fc-004e-43c6-b517-d798c49d7859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e1e1d8-cced-470f-980e-0e7246f944b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:44 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Volume volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a (6c5723d3-374b-4bcb-a1b2-c19a09798d5a): created successfully
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e1e1d8-cced-470f-980e-0e7246f944b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Flow 'volume_create_manager' (4c47e511-8a7a-4988-af19-8303d50d0a82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:24:45 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-eb107755-07f5-44fa-b508-22fe50bc0442 tempest-ProjectReaderTests-1286815890 None] Created volume successfully.
Nov 05 15:24:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-444a5edd-1b03-444c-9466-163bd6d68491 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-444a5edd-1b03-444c-9466-163bd6d68491 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-444a5edd-1b03-444c-9466-163bd6d68491 tempest-ProjectReaderTests-1286815890 None] Creating offline snapshot a246fbd8-88a5-4250-a9ee-b23021345527 of volume 6c5723d3-374b-4bcb-a1b2-c19a09798d5a {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:24:45 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6954cf-9ee5-4b71-a90f-7a2bf0ebf656]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-444a5edd-1b03-444c-9466-163bd6d68491 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:45 devstack sudo[108202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a
Nov 05 15:24:45 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:45 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-444a5edd-1b03-444c-9466-163bd6d68491 tempest-ProjectReaderTests-1286815890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a" returned: 0 in 0.347s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-444a5edd-1b03-444c-9466-163bd6d68491 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.a246fbd8-88a5-4250-a9ee-b23021345527 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:45 devstack sudo[108207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.a246fbd8-88a5-4250-a9ee-b23021345527 1G
Nov 05 15:24:45 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:46 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-444a5edd-1b03-444c-9466-163bd6d68491 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.a246fbd8-88a5-4250-a9ee-b23021345527 1G" returned: 0 in 0.387s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-444a5edd-1b03-444c-9466-163bd6d68491 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.a246fbd8-88a5-4250-a9ee-b23021345527 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:46 devstack sudo[108212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.a246fbd8-88a5-4250-a9ee-b23021345527
Nov 05 15:24:46 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:46 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-444a5edd-1b03-444c-9466-163bd6d68491 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.a246fbd8-88a5-4250-a9ee-b23021345527" returned: 0 in 0.291s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:46 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-444a5edd-1b03-444c-9466-163bd6d68491 tempest-ProjectReaderTests-1286815890 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.a246fbd8-88a5-4250-a9ee-b23021345527 is being set with open permissions: ugo+rw
Nov 05 15:24:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-444a5edd-1b03-444c-9466-163bd6d68491 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.a246fbd8-88a5-4250-a9ee-b23021345527 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:46 devstack sudo[108217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.a246fbd8-88a5-4250-a9ee-b23021345527
Nov 05 15:24:46 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:46 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-444a5edd-1b03-444c-9466-163bd6d68491 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.a246fbd8-88a5-4250-a9ee-b23021345527" returned: 0 in 0.246s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-444a5edd-1b03-444c-9466-163bd6d68491 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:46 devstack sudo[108220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.info
Nov 05 15:24:46 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:46 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-444a5edd-1b03-444c-9466-163bd6d68491 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.info" returned: 0 in 0.261s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:46 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-444a5edd-1b03-444c-9466-163bd6d68491 tempest-ProjectReaderTests-1286815890 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.info is being set with open permissions: ugo+rw
Nov 05 15:24:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-444a5edd-1b03-444c-9466-163bd6d68491 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:46 devstack sudo[108223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.info
Nov 05 15:24:46 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:47 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-444a5edd-1b03-444c-9466-163bd6d68491 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.info" returned: 0 in 0.238s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-444a5edd-1b03-444c-9466-163bd6d68491 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.849s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:47 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-444a5edd-1b03-444c-9466-163bd6d68491 tempest-ProjectReaderTests-1286815890 None] Create snapshot completed successfully
Nov 05 15:24:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0b165441-10cf-43ff-9388-e9a8ca40b90d tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-a246fbd8-88a5-4250-a9ee-b23021345527-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0b165441-10cf-43ff-9388-e9a8ca40b90d tempest-ProjectReaderTests-1286815890 None] Lock "cinder-a246fbd8-88a5-4250-a9ee-b23021345527-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0b165441-10cf-43ff-9388-e9a8ca40b90d tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-quobyte-6c5723d3-374b-4bcb-a1b2-c19a09798d5a" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0b165441-10cf-43ff-9388-e9a8ca40b90d tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-6c5723d3-374b-4bcb-a1b2-c19a09798d5a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0b165441-10cf-43ff-9388-e9a8ca40b90d tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-quobyte-a246fbd8-88a5-4250-a9ee-b23021345527" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0b165441-10cf-43ff-9388-e9a8ca40b90d tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-a246fbd8-88a5-4250-a9ee-b23021345527" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-0b165441-10cf-43ff-9388-e9a8ca40b90d tempest-ProjectReaderTests-1286815890 None] Deleting offline snapshot a246fbd8-88a5-4250-a9ee-b23021345527 of volume 6c5723d3-374b-4bcb-a1b2-c19a09798d5a {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:24:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-0b165441-10cf-43ff-9388-e9a8ca40b90d tempest-ProjectReaderTests-1286815890 None] snapshot_file for this snap is: volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.a246fbd8-88a5-4250-a9ee-b23021345527 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:24:47 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ffdc8d-a0ec-49e6-9461-1581f3387642]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b165441-10cf-43ff-9388-e9a8ca40b90d tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.a246fbd8-88a5-4250-a9ee-b23021345527 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:47 devstack sudo[108226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.a246fbd8-88a5-4250-a9ee-b23021345527
Nov 05 15:24:47 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:47 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b165441-10cf-43ff-9388-e9a8ca40b90d tempest-ProjectReaderTests-1286815890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.a246fbd8-88a5-4250-a9ee-b23021345527" returned: 0 in 0.360s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-0b165441-10cf-43ff-9388-e9a8ca40b90d tempest-ProjectReaderTests-1286815890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:24:47 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8563c9-64fa-4fb2-8425-11be14ee00f6]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b165441-10cf-43ff-9388-e9a8ca40b90d tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:48 devstack sudo[108231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a
Nov 05 15:24:48 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:48 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b165441-10cf-43ff-9388-e9a8ca40b90d tempest-ProjectReaderTests-1286815890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a" returned: 0 in 0.353s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b165441-10cf-43ff-9388-e9a8ca40b90d tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.a246fbd8-88a5-4250-a9ee-b23021345527 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:48 devstack sudo[108236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.a246fbd8-88a5-4250-a9ee-b23021345527
Nov 05 15:24:48 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:48 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b165441-10cf-43ff-9388-e9a8ca40b90d tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.a246fbd8-88a5-4250-a9ee-b23021345527" returned: 0 in 0.333s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b165441-10cf-43ff-9388-e9a8ca40b90d tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.a246fbd8-88a5-4250-a9ee-b23021345527 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:48 devstack sudo[108241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.a246fbd8-88a5-4250-a9ee-b23021345527
Nov 05 15:24:48 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:48 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b165441-10cf-43ff-9388-e9a8ca40b90d tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a.a246fbd8-88a5-4250-a9ee-b23021345527" returned: 0 in 0.246s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0b165441-10cf-43ff-9388-e9a8ca40b90d tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-a246fbd8-88a5-4250-a9ee-b23021345527" released by "_delete_snapshot" :: held 1.392s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0b165441-10cf-43ff-9388-e9a8ca40b90d tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-6c5723d3-374b-4bcb-a1b2-c19a09798d5a" released by "delete_snapshot" :: held 1.413s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:48 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-0b165441-10cf-43ff-9388-e9a8ca40b90d tempest-ProjectReaderTests-1286815890 None] Created reservations ['7ed318d4-cca1-4e4d-98df-c75c2b912b9f', 'f0027ef3-5410-4adf-8f4b-b83e87d29197', 'f593c429-6666-44d4-994b-8ec86b30418d', '65daf6b1-6759-4b64-88b7-18c9a8d5aaa0'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:24:49 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0b165441-10cf-43ff-9388-e9a8ca40b90d tempest-ProjectReaderTests-1286815890 None] Delete snapshot completed successfully.
Nov 05 15:24:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0b165441-10cf-43ff-9388-e9a8ca40b90d tempest-ProjectReaderTests-1286815890 None] Lock "cinder-a246fbd8-88a5-4250-a9ee-b23021345527-delete_snapshot" released by "delete_snapshot" :: held 1.543s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-06cecc58-2e5d-48f5-b338-5ad9b1a50e46 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-6c5723d3-374b-4bcb-a1b2-c19a09798d5a-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-06cecc58-2e5d-48f5-b338-5ad9b1a50e46 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-6c5723d3-374b-4bcb-a1b2-c19a09798d5a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-06cecc58-2e5d-48f5-b338-5ad9b1a50e46 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-quobyte-6c5723d3-374b-4bcb-a1b2-c19a09798d5a" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-06cecc58-2e5d-48f5-b338-5ad9b1a50e46 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-6c5723d3-374b-4bcb-a1b2-c19a09798d5a" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:49 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[18843636-bb96-4d16-9190-b0fbbd94adba]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-06cecc58-2e5d-48f5-b338-5ad9b1a50e46 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:49 devstack sudo[108245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a
Nov 05 15:24:49 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:50 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-06cecc58-2e5d-48f5-b338-5ad9b1a50e46 tempest-ProjectReaderTests-1286815890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a" returned: 0 in 0.364s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-06cecc58-2e5d-48f5-b338-5ad9b1a50e46 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:50 devstack sudo[108251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a
Nov 05 15:24:50 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:50 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-06cecc58-2e5d-48f5-b338-5ad9b1a50e46 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-6c5723d3-374b-4bcb-a1b2-c19a09798d5a" returned: 0 in 0.234s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-06cecc58-2e5d-48f5-b338-5ad9b1a50e46 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-6c5723d3-374b-4bcb-a1b2-c19a09798d5a" released by "delete_volume" :: held 0.662s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:50 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-06cecc58-2e5d-48f5-b338-5ad9b1a50e46 tempest-ProjectReaderTests-1286815890 None] Created reservations ['f063d81c-c50a-42b9-a241-8a7a64ec2b38', 'e455a3b7-2a8b-4d49-815f-3f4105dcc192', '3c8b1195-0025-4576-866d-7560cc6be0f1', 'af123363-26b0-4bef-8034-ebc36920b373'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:24:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-06cecc58-2e5d-48f5-b338-5ad9b1a50e46 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-06cecc58-2e5d-48f5-b338-5ad9b1a50e46 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-06cecc58-2e5d-48f5-b338-5ad9b1a50e46 tempest-ProjectReaderTests-1286815890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-06cecc58-2e5d-48f5-b338-5ad9b1a50e46 tempest-ProjectReaderTests-1286815890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-06cecc58-2e5d-48f5-b338-5ad9b1a50e46 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-06cecc58-2e5d-48f5-b338-5ad9b1a50e46 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:50 devstack sudo[108254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:24:50 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:50 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-06cecc58-2e5d-48f5-b338-5ad9b1a50e46 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.249s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:50 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-06cecc58-2e5d-48f5-b338-5ad9b1a50e46 tempest-ProjectReaderTests-1286815890 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:24:50 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-06cecc58-2e5d-48f5-b338-5ad9b1a50e46 tempest-ProjectReaderTests-1286815890 None] Deleted volume successfully.
Nov 05 15:24:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-06cecc58-2e5d-48f5-b338-5ad9b1a50e46 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-6c5723d3-374b-4bcb-a1b2-c19a09798d5a-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Flow 'volume_create_manager' (bd4ba593-0e4d-4612-927f-bb93771d29d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a59d24d-2e2c-4054-833b-9310e65386d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a59d24d-2e2c-4054-833b-9310e65386d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1655703010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de38950-41bc-4432-a4c2-979f701196be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0310c9a825344e0a4b8b5ff9eb39ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:24:51Z,use_quota=True,user_id='66aaa5bcdee04fa2a9af482320d258f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e448edf-f90a-493d-8fa5-df272207b638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e448edf-f90a-493d-8fa5-df272207b638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978bbfc1-f801-4c1f-9c59-828aff1de64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978bbfc1-f801-4c1f-9c59-828aff1de64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0de38950-41bc-4432-a4c2-979f701196be', 'volume_name': 'volume-0de38950-41bc-4432-a4c2-979f701196be', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da04d699-6d23-4785-9d95-87ec253d4b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da04d699-6d23-4785-9d95-87ec253d4b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef0b2458-2329-46c7-ad44-1e1d38e1433d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:51 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Volume 0de38950-41bc-4432-a4c2-979f701196be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0de38950-41bc-4432-a4c2-979f701196be', 'volume_size': 1}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1655703010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de38950-41bc-4432-a4c2-979f701196be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0310c9a825344e0a4b8b5ff9eb39ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:24:51Z,use_quota=True,user_id='66aaa5bcdee04fa2a9af482320d258f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Creating volume 0de38950-41bc-4432-a4c2-979f701196be {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:24:51 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:51 devstack sudo[108257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be 1073741824
Nov 05 15:24:51 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:51 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be 1073741824" returned: 0 in 0.406s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:51 devstack sudo[108263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be
Nov 05 15:24:51 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:51 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be" returned: 0 in 0.240s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef0b2458-2329-46c7-ad44-1e1d38e1433d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0de38950-41bc-4432-a4c2-979f701196be', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98492a03-8368-490d-8332-864aee161211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:51 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Volume volume-0de38950-41bc-4432-a4c2-979f701196be (0de38950-41bc-4432-a4c2-979f701196be): created successfully
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98492a03-8368-490d-8332-864aee161211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Flow 'volume_create_manager' (bd4ba593-0e4d-4612-927f-bb93771d29d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:24:51 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f11c9479-4413-493f-9ae5-24cc24ed8ce0 tempest-ProjectReaderTests-1286815890 None] Created volume successfully.
Nov 05 15:24:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a9ad9f6f-781f-4c1b-a1b7-14e477d7aa67 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a9ad9f6f-781f-4c1b-a1b7-14e477d7aa67 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a9ad9f6f-781f-4c1b-a1b7-14e477d7aa67 tempest-ProjectReaderTests-1286815890 None] Creating offline snapshot 1b0656d9-c000-4fcd-b1ec-b696730b772b of volume 0de38950-41bc-4432-a4c2-979f701196be {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:24:52 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[707cb330-87ae-49df-be35-0268884f3db3]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9ad9f6f-781f-4c1b-a1b7-14e477d7aa67 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:52 devstack sudo[108266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be
Nov 05 15:24:52 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:52 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9ad9f6f-781f-4c1b-a1b7-14e477d7aa67 tempest-ProjectReaderTests-1286815890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be" returned: 0 in 0.379s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9ad9f6f-781f-4c1b-a1b7-14e477d7aa67 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.1b0656d9-c000-4fcd-b1ec-b696730b772b 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:52 devstack sudo[108271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.1b0656d9-c000-4fcd-b1ec-b696730b772b 1G
Nov 05 15:24:52 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:53 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9ad9f6f-781f-4c1b-a1b7-14e477d7aa67 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.1b0656d9-c000-4fcd-b1ec-b696730b772b 1G" returned: 0 in 0.381s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9ad9f6f-781f-4c1b-a1b7-14e477d7aa67 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0de38950-41bc-4432-a4c2-979f701196be -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.1b0656d9-c000-4fcd-b1ec-b696730b772b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:53 devstack sudo[108276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0de38950-41bc-4432-a4c2-979f701196be -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.1b0656d9-c000-4fcd-b1ec-b696730b772b
Nov 05 15:24:53 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:53 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9ad9f6f-781f-4c1b-a1b7-14e477d7aa67 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0de38950-41bc-4432-a4c2-979f701196be -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.1b0656d9-c000-4fcd-b1ec-b696730b772b" returned: 0 in 0.278s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:53 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-a9ad9f6f-781f-4c1b-a1b7-14e477d7aa67 tempest-ProjectReaderTests-1286815890 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.1b0656d9-c000-4fcd-b1ec-b696730b772b is being set with open permissions: ugo+rw
Nov 05 15:24:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9ad9f6f-781f-4c1b-a1b7-14e477d7aa67 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.1b0656d9-c000-4fcd-b1ec-b696730b772b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:53 devstack sudo[108281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.1b0656d9-c000-4fcd-b1ec-b696730b772b
Nov 05 15:24:53 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:53 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9ad9f6f-781f-4c1b-a1b7-14e477d7aa67 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.1b0656d9-c000-4fcd-b1ec-b696730b772b" returned: 0 in 0.242s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9ad9f6f-781f-4c1b-a1b7-14e477d7aa67 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:53 devstack sudo[108284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.info
Nov 05 15:24:53 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:53 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9ad9f6f-781f-4c1b-a1b7-14e477d7aa67 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.info" returned: 0 in 0.253s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:53 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-a9ad9f6f-781f-4c1b-a1b7-14e477d7aa67 tempest-ProjectReaderTests-1286815890 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.info is being set with open permissions: ugo+rw
Nov 05 15:24:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9ad9f6f-781f-4c1b-a1b7-14e477d7aa67 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:53 devstack sudo[108287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.info
Nov 05 15:24:53 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:54 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9ad9f6f-781f-4c1b-a1b7-14e477d7aa67 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.info" returned: 0 in 0.253s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a9ad9f6f-781f-4c1b-a1b7-14e477d7aa67 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.860s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:54 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a9ad9f6f-781f-4c1b-a1b7-14e477d7aa67 tempest-ProjectReaderTests-1286815890 None] Create snapshot completed successfully
Nov 05 15:24:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f86a9c9f-8d2a-4b6e-ba37-e6a5420f6343 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-1b0656d9-c000-4fcd-b1ec-b696730b772b-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f86a9c9f-8d2a-4b6e-ba37-e6a5420f6343 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-1b0656d9-c000-4fcd-b1ec-b696730b772b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f86a9c9f-8d2a-4b6e-ba37-e6a5420f6343 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-quobyte-0de38950-41bc-4432-a4c2-979f701196be" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f86a9c9f-8d2a-4b6e-ba37-e6a5420f6343 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-0de38950-41bc-4432-a4c2-979f701196be" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f86a9c9f-8d2a-4b6e-ba37-e6a5420f6343 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-quobyte-1b0656d9-c000-4fcd-b1ec-b696730b772b" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f86a9c9f-8d2a-4b6e-ba37-e6a5420f6343 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-1b0656d9-c000-4fcd-b1ec-b696730b772b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-f86a9c9f-8d2a-4b6e-ba37-e6a5420f6343 tempest-ProjectReaderTests-1286815890 None] Deleting offline snapshot 1b0656d9-c000-4fcd-b1ec-b696730b772b of volume 0de38950-41bc-4432-a4c2-979f701196be {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:24:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-f86a9c9f-8d2a-4b6e-ba37-e6a5420f6343 tempest-ProjectReaderTests-1286815890 None] snapshot_file for this snap is: volume-0de38950-41bc-4432-a4c2-979f701196be.1b0656d9-c000-4fcd-b1ec-b696730b772b {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:24:54 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8e5cd7-3206-4a37-b8e2-7115e6e730b8]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f86a9c9f-8d2a-4b6e-ba37-e6a5420f6343 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.1b0656d9-c000-4fcd-b1ec-b696730b772b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:54 devstack sudo[108290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.1b0656d9-c000-4fcd-b1ec-b696730b772b
Nov 05 15:24:54 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:54 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f86a9c9f-8d2a-4b6e-ba37-e6a5420f6343 tempest-ProjectReaderTests-1286815890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.1b0656d9-c000-4fcd-b1ec-b696730b772b" returned: 0 in 0.362s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-f86a9c9f-8d2a-4b6e-ba37-e6a5420f6343 tempest-ProjectReaderTests-1286815890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0de38950-41bc-4432-a4c2-979f701196be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:24:54 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a0f001-8441-4bc8-a279-86f560bc10a0]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f86a9c9f-8d2a-4b6e-ba37-e6a5420f6343 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:55 devstack sudo[108296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be
Nov 05 15:24:55 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:55 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f86a9c9f-8d2a-4b6e-ba37-e6a5420f6343 tempest-ProjectReaderTests-1286815890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be" returned: 0 in 0.345s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f86a9c9f-8d2a-4b6e-ba37-e6a5420f6343 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.1b0656d9-c000-4fcd-b1ec-b696730b772b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:55 devstack sudo[108301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.1b0656d9-c000-4fcd-b1ec-b696730b772b
Nov 05 15:24:55 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:55 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f86a9c9f-8d2a-4b6e-ba37-e6a5420f6343 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.1b0656d9-c000-4fcd-b1ec-b696730b772b" returned: 0 in 0.326s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f86a9c9f-8d2a-4b6e-ba37-e6a5420f6343 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.1b0656d9-c000-4fcd-b1ec-b696730b772b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:55 devstack sudo[108306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.1b0656d9-c000-4fcd-b1ec-b696730b772b
Nov 05 15:24:55 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:55 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f86a9c9f-8d2a-4b6e-ba37-e6a5420f6343 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be.1b0656d9-c000-4fcd-b1ec-b696730b772b" returned: 0 in 0.235s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f86a9c9f-8d2a-4b6e-ba37-e6a5420f6343 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-1b0656d9-c000-4fcd-b1ec-b696730b772b" released by "_delete_snapshot" :: held 1.369s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f86a9c9f-8d2a-4b6e-ba37-e6a5420f6343 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-0de38950-41bc-4432-a4c2-979f701196be" released by "delete_snapshot" :: held 1.390s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:55 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-f86a9c9f-8d2a-4b6e-ba37-e6a5420f6343 tempest-ProjectReaderTests-1286815890 None] Created reservations ['441b40a4-419a-4e6b-8e01-8bda5eaf3b1e', 'f4bb9eaa-60e9-4511-beb5-c5999bb5776f', '91101936-294f-4442-a80f-1c81faa92814', '0f981ba1-f0a3-4372-9db1-806c188c5bd8'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:24:55 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f86a9c9f-8d2a-4b6e-ba37-e6a5420f6343 tempest-ProjectReaderTests-1286815890 None] Delete snapshot completed successfully.
Nov 05 15:24:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f86a9c9f-8d2a-4b6e-ba37-e6a5420f6343 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-1b0656d9-c000-4fcd-b1ec-b696730b772b-delete_snapshot" released by "delete_snapshot" :: held 1.510s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-55598ab9-0301-411b-8886-2e2207515644 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-0de38950-41bc-4432-a4c2-979f701196be-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-55598ab9-0301-411b-8886-2e2207515644 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-0de38950-41bc-4432-a4c2-979f701196be-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-55598ab9-0301-411b-8886-2e2207515644 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-quobyte-0de38950-41bc-4432-a4c2-979f701196be" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:24:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-55598ab9-0301-411b-8886-2e2207515644 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-0de38950-41bc-4432-a4c2-979f701196be" acquired by "delete_volume" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:24:56 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7056192-962d-428c-bc95-e017135cc721]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-55598ab9-0301-411b-8886-2e2207515644 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:56 devstack sudo[108309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be
Nov 05 15:24:56 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:57 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-55598ab9-0301-411b-8886-2e2207515644 tempest-ProjectReaderTests-1286815890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be" returned: 0 in 0.343s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-55598ab9-0301-411b-8886-2e2207515644 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:57 devstack sudo[108314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be
Nov 05 15:24:57 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:57 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-55598ab9-0301-411b-8886-2e2207515644 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-0de38950-41bc-4432-a4c2-979f701196be" returned: 0 in 0.242s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-55598ab9-0301-411b-8886-2e2207515644 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-0de38950-41bc-4432-a4c2-979f701196be" released by "delete_volume" :: held 0.645s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:57 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-55598ab9-0301-411b-8886-2e2207515644 tempest-ProjectReaderTests-1286815890 None] Created reservations ['658a6f6e-3f60-48a8-a3ce-b95650febb6a', '6d6d9171-3899-49c0-b9a4-d7727ae32175', '31be7fa6-28fc-4a0b-9a01-451683650749', '707812ec-0d01-4cc6-8ca5-c00eed0d1bf7'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:24:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-55598ab9-0301-411b-8886-2e2207515644 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-55598ab9-0301-411b-8886-2e2207515644 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-55598ab9-0301-411b-8886-2e2207515644 tempest-ProjectReaderTests-1286815890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-55598ab9-0301-411b-8886-2e2207515644 tempest-ProjectReaderTests-1286815890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-55598ab9-0301-411b-8886-2e2207515644 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-55598ab9-0301-411b-8886-2e2207515644 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:57 devstack sudo[108317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:24:57 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:57 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-55598ab9-0301-411b-8886-2e2207515644 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.240s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:57 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-55598ab9-0301-411b-8886-2e2207515644 tempest-ProjectReaderTests-1286815890 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:24:57 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-55598ab9-0301-411b-8886-2e2207515644 tempest-ProjectReaderTests-1286815890 None] Deleted volume successfully.
Nov 05 15:24:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-55598ab9-0301-411b-8886-2e2207515644 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-0de38950-41bc-4432-a4c2-979f701196be-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Flow 'volume_create_manager' (3ce6db94-b2e2-403f-a031-b9a27655b80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ebad93b-30c7-413d-bf67-9a37c5def804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ebad93b-30c7-413d-bf67-9a37c5def804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-301963072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d733b42e-7855-4ab0-8210-8abf243dfac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0310c9a825344e0a4b8b5ff9eb39ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:24:58Z,use_quota=True,user_id='66aaa5bcdee04fa2a9af482320d258f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a39686e3-74ff-48f0-b241-826b2a5b15e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a39686e3-74ff-48f0-b241-826b2a5b15e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42fb5508-f246-4c1a-af8a-71d9db751517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42fb5508-f246-4c1a-af8a-71d9db751517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd733b42e-7855-4ab0-8210-8abf243dfac5', 'volume_name': 'volume-d733b42e-7855-4ab0-8210-8abf243dfac5', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d399a0a3-cbf1-4db1-ae60-036370424653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d399a0a3-cbf1-4db1-ae60-036370424653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0fa5aa0-918e-4db8-80e8-1648338d0b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:58 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Volume d733b42e-7855-4ab0-8210-8abf243dfac5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d733b42e-7855-4ab0-8210-8abf243dfac5', 'volume_size': 1}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-301963072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d733b42e-7855-4ab0-8210-8abf243dfac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0310c9a825344e0a4b8b5ff9eb39ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:24:58Z,use_quota=True,user_id='66aaa5bcdee04fa2a9af482320d258f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Creating volume d733b42e-7855-4ab0-8210-8abf243dfac5 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:24:58 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:58 devstack sudo[108320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5 1073741824
Nov 05 15:24:58 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:58 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5 1073741824" returned: 0 in 0.398s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:58 devstack sudo[108326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5
Nov 05 15:24:58 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:58 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5" returned: 0 in 0.253s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0fa5aa0-918e-4db8-80e8-1648338d0b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d733b42e-7855-4ab0-8210-8abf243dfac5', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84912da3-5828-4dc9-9ff1-882846da008b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:24:58 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Volume volume-d733b42e-7855-4ab0-8210-8abf243dfac5 (d733b42e-7855-4ab0-8210-8abf243dfac5): created successfully
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84912da3-5828-4dc9-9ff1-882846da008b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:24:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Flow 'volume_create_manager' (3ce6db94-b2e2-403f-a031-b9a27655b80c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:24:58 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-bf7c1b92-9589-4a64-88f6-ca2fce014433 tempest-ProjectReaderTests-1286815890 None] Created volume successfully.
Nov 05 15:24:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d39fb2d0-892f-4c8e-822f-dbc8c3038048 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:24:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d39fb2d0-892f-4c8e-822f-dbc8c3038048 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:24:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-d39fb2d0-892f-4c8e-822f-dbc8c3038048 tempest-ProjectReaderTests-1286815890 None] Creating offline snapshot 0adc9db6-1166-4d84-a88a-ffde2d8418db of volume d733b42e-7855-4ab0-8210-8abf243dfac5 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:24:59 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ff273b-e409-413b-8a0f-ac14e9560151]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:24:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d39fb2d0-892f-4c8e-822f-dbc8c3038048 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:59 devstack sudo[108329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5
Nov 05 15:24:59 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:24:59 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root
Nov 05 15:24:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d39fb2d0-892f-4c8e-822f-dbc8c3038048 tempest-ProjectReaderTests-1286815890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5" returned: 0 in 0.352s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:24:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d39fb2d0-892f-4c8e-822f-dbc8c3038048 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.0adc9db6-1166-4d84-a88a-ffde2d8418db 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:24:59 devstack sudo[108335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.0adc9db6-1166-4d84-a88a-ffde2d8418db 1G
Nov 05 15:24:59 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:00 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d39fb2d0-892f-4c8e-822f-dbc8c3038048 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.0adc9db6-1166-4d84-a88a-ffde2d8418db 1G" returned: 0 in 0.388s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d39fb2d0-892f-4c8e-822f-dbc8c3038048 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d733b42e-7855-4ab0-8210-8abf243dfac5 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.0adc9db6-1166-4d84-a88a-ffde2d8418db {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:00 devstack sudo[108340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d733b42e-7855-4ab0-8210-8abf243dfac5 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.0adc9db6-1166-4d84-a88a-ffde2d8418db
Nov 05 15:25:00 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:00 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d39fb2d0-892f-4c8e-822f-dbc8c3038048 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d733b42e-7855-4ab0-8210-8abf243dfac5 -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.0adc9db6-1166-4d84-a88a-ffde2d8418db" returned: 0 in 0.285s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:00 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-d39fb2d0-892f-4c8e-822f-dbc8c3038048 tempest-ProjectReaderTests-1286815890 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.0adc9db6-1166-4d84-a88a-ffde2d8418db is being set with open permissions: ugo+rw
Nov 05 15:25:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d39fb2d0-892f-4c8e-822f-dbc8c3038048 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.0adc9db6-1166-4d84-a88a-ffde2d8418db {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:00 devstack sudo[108345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.0adc9db6-1166-4d84-a88a-ffde2d8418db
Nov 05 15:25:00 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:00 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d39fb2d0-892f-4c8e-822f-dbc8c3038048 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.0adc9db6-1166-4d84-a88a-ffde2d8418db" returned: 0 in 0.248s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d39fb2d0-892f-4c8e-822f-dbc8c3038048 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:00 devstack sudo[108348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.info
Nov 05 15:25:00 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:00 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d39fb2d0-892f-4c8e-822f-dbc8c3038048 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.info" returned: 0 in 0.251s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:00 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-d39fb2d0-892f-4c8e-822f-dbc8c3038048 tempest-ProjectReaderTests-1286815890 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.info is being set with open permissions: ugo+rw
Nov 05 15:25:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d39fb2d0-892f-4c8e-822f-dbc8c3038048 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:00 devstack sudo[108351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.info
Nov 05 15:25:00 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:01 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d39fb2d0-892f-4c8e-822f-dbc8c3038048 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.info" returned: 0 in 0.233s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d39fb2d0-892f-4c8e-822f-dbc8c3038048 tempest-ProjectReaderTests-1286815890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.837s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:25:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d39fb2d0-892f-4c8e-822f-dbc8c3038048 tempest-ProjectReaderTests-1286815890 None] Create snapshot completed successfully
Nov 05 15:25:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dcf1471a-dd40-4542-afc9-45e2b4706c72 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-0adc9db6-1166-4d84-a88a-ffde2d8418db-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:25:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dcf1471a-dd40-4542-afc9-45e2b4706c72 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-0adc9db6-1166-4d84-a88a-ffde2d8418db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:25:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dcf1471a-dd40-4542-afc9-45e2b4706c72 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-quobyte-d733b42e-7855-4ab0-8210-8abf243dfac5" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:25:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dcf1471a-dd40-4542-afc9-45e2b4706c72 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-d733b42e-7855-4ab0-8210-8abf243dfac5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:25:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dcf1471a-dd40-4542-afc9-45e2b4706c72 tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-quobyte-0adc9db6-1166-4d84-a88a-ffde2d8418db" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:25:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dcf1471a-dd40-4542-afc9-45e2b4706c72 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-0adc9db6-1166-4d84-a88a-ffde2d8418db" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:25:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-dcf1471a-dd40-4542-afc9-45e2b4706c72 tempest-ProjectReaderTests-1286815890 None] Deleting offline snapshot 0adc9db6-1166-4d84-a88a-ffde2d8418db of volume d733b42e-7855-4ab0-8210-8abf243dfac5 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:25:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-dcf1471a-dd40-4542-afc9-45e2b4706c72 tempest-ProjectReaderTests-1286815890 None] snapshot_file for this snap is: volume-d733b42e-7855-4ab0-8210-8abf243dfac5.0adc9db6-1166-4d84-a88a-ffde2d8418db {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:25:01 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2dfe3f-0280-494b-b610-96dcb9c125f7]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:25:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dcf1471a-dd40-4542-afc9-45e2b4706c72 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.0adc9db6-1166-4d84-a88a-ffde2d8418db {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:01 devstack sudo[108357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.0adc9db6-1166-4d84-a88a-ffde2d8418db
Nov 05 15:25:01 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:01 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dcf1471a-dd40-4542-afc9-45e2b4706c72 tempest-ProjectReaderTests-1286815890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.0adc9db6-1166-4d84-a88a-ffde2d8418db" returned: 0 in 0.365s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-dcf1471a-dd40-4542-afc9-45e2b4706c72 tempest-ProjectReaderTests-1286815890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d733b42e-7855-4ab0-8210-8abf243dfac5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:25:01 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[246d15c6-ea0e-411b-a65f-e949677b7ac9]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:25:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dcf1471a-dd40-4542-afc9-45e2b4706c72 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:02 devstack sudo[108363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5
Nov 05 15:25:02 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:02 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dcf1471a-dd40-4542-afc9-45e2b4706c72 tempest-ProjectReaderTests-1286815890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5" returned: 0 in 0.352s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dcf1471a-dd40-4542-afc9-45e2b4706c72 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.0adc9db6-1166-4d84-a88a-ffde2d8418db {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:02 devstack sudo[108368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.0adc9db6-1166-4d84-a88a-ffde2d8418db
Nov 05 15:25:02 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:02 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dcf1471a-dd40-4542-afc9-45e2b4706c72 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.0adc9db6-1166-4d84-a88a-ffde2d8418db" returned: 0 in 0.329s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dcf1471a-dd40-4542-afc9-45e2b4706c72 tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.0adc9db6-1166-4d84-a88a-ffde2d8418db {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:02 devstack sudo[108373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.0adc9db6-1166-4d84-a88a-ffde2d8418db
Nov 05 15:25:02 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:02 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dcf1471a-dd40-4542-afc9-45e2b4706c72 tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5.0adc9db6-1166-4d84-a88a-ffde2d8418db" returned: 0 in 0.241s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dcf1471a-dd40-4542-afc9-45e2b4706c72 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-0adc9db6-1166-4d84-a88a-ffde2d8418db" released by "_delete_snapshot" :: held 1.395s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:25:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dcf1471a-dd40-4542-afc9-45e2b4706c72 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-d733b42e-7855-4ab0-8210-8abf243dfac5" released by "delete_snapshot" :: held 1.417s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:25:02 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-dcf1471a-dd40-4542-afc9-45e2b4706c72 tempest-ProjectReaderTests-1286815890 None] Created reservations ['84869b41-2c74-4e87-8cdb-fd80d8d4c245', 'a1cd1bb5-8834-4822-92be-110d6c529aa3', 'eb7b399d-5124-4b65-be09-3a1c952f8db0', '4d5a1066-221f-4117-8381-aaaa1bef435f'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:25:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-dcf1471a-dd40-4542-afc9-45e2b4706c72 tempest-ProjectReaderTests-1286815890 None] Delete snapshot completed successfully.
Nov 05 15:25:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dcf1471a-dd40-4542-afc9-45e2b4706c72 tempest-ProjectReaderTests-1286815890 None] Lock "cinder-0adc9db6-1166-4d84-a88a-ffde2d8418db-delete_snapshot" released by "delete_snapshot" :: held 1.544s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:25:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4e3d5182-13e2-41c4-ac26-8d1403cc4b1a tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-d733b42e-7855-4ab0-8210-8abf243dfac5-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:25:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4e3d5182-13e2-41c4-ac26-8d1403cc4b1a tempest-ProjectReaderTests-1286815890 None] Lock "cinder-d733b42e-7855-4ab0-8210-8abf243dfac5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:25:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4e3d5182-13e2-41c4-ac26-8d1403cc4b1a tempest-ProjectReaderTests-1286815890 None] Acquiring lock "cinder-quobyte-d733b42e-7855-4ab0-8210-8abf243dfac5" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:25:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4e3d5182-13e2-41c4-ac26-8d1403cc4b1a tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-d733b42e-7855-4ab0-8210-8abf243dfac5" acquired by "delete_volume" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:25:03 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[32458d63-f076-49a3-b8ce-d7bbe391f79c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:25:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4e3d5182-13e2-41c4-ac26-8d1403cc4b1a tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:03 devstack sudo[108376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5
Nov 05 15:25:03 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:04 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4e3d5182-13e2-41c4-ac26-8d1403cc4b1a tempest-ProjectReaderTests-1286815890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5" returned: 0 in 0.353s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4e3d5182-13e2-41c4-ac26-8d1403cc4b1a tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:04 devstack sudo[108381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5
Nov 05 15:25:04 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:04 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4e3d5182-13e2-41c4-ac26-8d1403cc4b1a tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-d733b42e-7855-4ab0-8210-8abf243dfac5" returned: 0 in 0.243s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4e3d5182-13e2-41c4-ac26-8d1403cc4b1a tempest-ProjectReaderTests-1286815890 None] Lock "cinder-quobyte-d733b42e-7855-4ab0-8210-8abf243dfac5" released by "delete_volume" :: held 0.658s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:25:04 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-4e3d5182-13e2-41c4-ac26-8d1403cc4b1a tempest-ProjectReaderTests-1286815890 None] Created reservations ['8bea1472-1f55-4427-b2bd-1af6be01d005', 'b02d56a1-dbb0-4c62-9823-39fbe12dd7da', 'a0b462c5-1b4e-4c4a-a291-f484b14ec997', '948ca674-4e5c-42ee-8d77-c01469105c92'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:25:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4e3d5182-13e2-41c4-ac26-8d1403cc4b1a tempest-ProjectReaderTests-1286815890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:25:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4e3d5182-13e2-41c4-ac26-8d1403cc4b1a tempest-ProjectReaderTests-1286815890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:25:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4e3d5182-13e2-41c4-ac26-8d1403cc4b1a tempest-ProjectReaderTests-1286815890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:25:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4e3d5182-13e2-41c4-ac26-8d1403cc4b1a tempest-ProjectReaderTests-1286815890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:25:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4e3d5182-13e2-41c4-ac26-8d1403cc4b1a tempest-ProjectReaderTests-1286815890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:25:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4e3d5182-13e2-41c4-ac26-8d1403cc4b1a tempest-ProjectReaderTests-1286815890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:04 devstack sudo[108384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:25:04 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:04 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4e3d5182-13e2-41c4-ac26-8d1403cc4b1a tempest-ProjectReaderTests-1286815890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.241s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:04 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-4e3d5182-13e2-41c4-ac26-8d1403cc4b1a tempest-ProjectReaderTests-1286815890 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:25:04 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4e3d5182-13e2-41c4-ac26-8d1403cc4b1a tempest-ProjectReaderTests-1286815890 None] Deleted volume successfully.
Nov 05 15:25:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4e3d5182-13e2-41c4-ac26-8d1403cc4b1a tempest-ProjectReaderTests-1286815890 None] Lock "cinder-d733b42e-7855-4ab0-8210-8abf243dfac5-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:25:14 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=56,cinder:UPDATE=69,cinder:DELETE=5,cinder:INSERT=16 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:25:14 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=70,cinder:DELETE=7,cinder:SELECT=52,cinder:INSERT=23 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Flow 'volume_create_manager' (b0b4d91c-0a85-4467-a98a-392d97bb3c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87933b92-c3ba-45b6-85c6-ca1854a5f512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87933b92-c3ba-45b6-85c6-ca1854a5f512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-677226194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151f70d4-c9cb-4b4e-aea3-4d3e8042518a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21ad5950d2149c7b8979b59439fe5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:25:25Z,use_quota=True,user_id='48038802e2d1460cb2e3ea5f14112cd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa5e0156-95f4-4ac9-ae32-9f2c55ab0a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa5e0156-95f4-4ac9-ae32-9f2c55ab0a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4444114a-0d2e-49df-be3b-a69b62c300c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4444114a-0d2e-49df-be3b-a69b62c300c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '151f70d4-c9cb-4b4e-aea3-4d3e8042518a', 'volume_name': 'volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ece021a-4045-4db8-9fd9-8855647d8ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ece021a-4045-4db8-9fd9-8855647d8ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff6ecfb-cd44-4a0e-a0c2-0fd4640f1265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:25:25 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Volume 151f70d4-c9cb-4b4e-aea3-4d3e8042518a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a', 'volume_size': 1}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bfada237d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-677226194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151f70d4-c9cb-4b4e-aea3-4d3e8042518a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21ad5950d2149c7b8979b59439fe5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:25:25Z,use_quota=True,user_id='48038802e2d1460cb2e3ea5f14112cd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Creating volume 151f70d4-c9cb-4b4e-aea3-4d3e8042518a {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:25:25 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] casted to osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:25 devstack sudo[108816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a 1073741824
Nov 05 15:25:25 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:25 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a 1073741824" returned: 0 in 0.397s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:25 devstack sudo[108822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a
Nov 05 15:25:25 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:25 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a" returned: 0 in 0.242s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff6ecfb-cd44-4a0e-a0c2-0fd4640f1265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97b85d7b-dccb-4732-8672-46fe3a559353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:25:25 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Volume volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a (151f70d4-c9cb-4b4e-aea3-4d3e8042518a): created successfully
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97b85d7b-dccb-4732-8672-46fe3a559353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:25:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Flow 'volume_create_manager' (b0b4d91c-0a85-4467-a98a-392d97bb3c19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:25:25 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-01bb556b-ee2f-497c-8925-a9409d66f53d tempest-SnapshotDependencyTests-373200153 None] Created volume successfully.
Nov 05 15:25:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7a1bdf68-882d-4fa5-9344-897bbfcff92d tempest-SnapshotDependencyTests-373200153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:25:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7a1bdf68-882d-4fa5-9344-897bbfcff92d tempest-SnapshotDependencyTests-373200153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:25:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7a1bdf68-882d-4fa5-9344-897bbfcff92d tempest-SnapshotDependencyTests-373200153 None] Creating offline snapshot 37841246-192c-4f28-8ecb-98e4327a30df of volume 151f70d4-c9cb-4b4e-aea3-4d3e8042518a {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 15:25:26 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d9626a-e042-4ae2-86b5-4a00247f4ba1]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:25:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7a1bdf68-882d-4fa5-9344-897bbfcff92d tempest-SnapshotDependencyTests-373200153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:26 devstack sudo[108825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a
Nov 05 15:25:26 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:26 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7a1bdf68-882d-4fa5-9344-897bbfcff92d tempest-SnapshotDependencyTests-373200153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a" returned: 0 in 0.367s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7a1bdf68-882d-4fa5-9344-897bbfcff92d tempest-SnapshotDependencyTests-373200153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.37841246-192c-4f28-8ecb-98e4327a30df 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:26 devstack sudo[108844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.37841246-192c-4f28-8ecb-98e4327a30df 1G
Nov 05 15:25:26 devstack sudo[108844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:27 devstack sudo[108844]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7a1bdf68-882d-4fa5-9344-897bbfcff92d tempest-SnapshotDependencyTests-373200153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.37841246-192c-4f28-8ecb-98e4327a30df 1G" returned: 0 in 0.402s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7a1bdf68-882d-4fa5-9344-897bbfcff92d tempest-SnapshotDependencyTests-373200153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.37841246-192c-4f28-8ecb-98e4327a30df {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:27 devstack sudo[108871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.37841246-192c-4f28-8ecb-98e4327a30df
Nov 05 15:25:27 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:27 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7a1bdf68-882d-4fa5-9344-897bbfcff92d tempest-SnapshotDependencyTests-373200153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a -F qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.37841246-192c-4f28-8ecb-98e4327a30df" returned: 0 in 0.299s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:27 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-7a1bdf68-882d-4fa5-9344-897bbfcff92d tempest-SnapshotDependencyTests-373200153 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.37841246-192c-4f28-8ecb-98e4327a30df is being set with open permissions: ugo+rw
Nov 05 15:25:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7a1bdf68-882d-4fa5-9344-897bbfcff92d tempest-SnapshotDependencyTests-373200153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.37841246-192c-4f28-8ecb-98e4327a30df {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:27 devstack sudo[108876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.37841246-192c-4f28-8ecb-98e4327a30df
Nov 05 15:25:27 devstack sudo[108876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:27 devstack sudo[108876]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7a1bdf68-882d-4fa5-9344-897bbfcff92d tempest-SnapshotDependencyTests-373200153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.37841246-192c-4f28-8ecb-98e4327a30df" returned: 0 in 0.253s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7a1bdf68-882d-4fa5-9344-897bbfcff92d tempest-SnapshotDependencyTests-373200153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:27 devstack sudo[108879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.info
Nov 05 15:25:27 devstack sudo[108879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:27 devstack sudo[108879]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7a1bdf68-882d-4fa5-9344-897bbfcff92d tempest-SnapshotDependencyTests-373200153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.info" returned: 0 in 0.248s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:27 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-7a1bdf68-882d-4fa5-9344-897bbfcff92d tempest-SnapshotDependencyTests-373200153 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.info is being set with open permissions: ugo+rw
Nov 05 15:25:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7a1bdf68-882d-4fa5-9344-897bbfcff92d tempest-SnapshotDependencyTests-373200153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:28 devstack sudo[108882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.info
Nov 05 15:25:28 devstack sudo[108882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:28 devstack sudo[108882]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7a1bdf68-882d-4fa5-9344-897bbfcff92d tempest-SnapshotDependencyTests-373200153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.info" returned: 0 in 0.234s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7a1bdf68-882d-4fa5-9344-897bbfcff92d tempest-SnapshotDependencyTests-373200153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:25:28 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7a1bdf68-882d-4fa5-9344-897bbfcff92d tempest-SnapshotDependencyTests-373200153 None] Create snapshot completed successfully
Nov 05 15:25:28 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Flow 'volume_create_manager' (09e51df3-4b3c-45d3-af93-aa58e2238e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60f6f00-6434-4aa1-9f60-00291c31fd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60f6f00-6434-4aa1-9f60-00291c31fd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T14:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdbc579b-e301-45a2-ad99-cf2669cd0ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21ad5950d2149c7b8979b59439fe5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=37841246-192c-4f28-8ecb-98e4327a30df,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:25:29Z,use_quota=True,user_id='48038802e2d1460cb2e3ea5f14112cd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9915636-ca40-4d2e-8775-a58e78301c36),volume_type_id=a9915636-ca40-4d2e-8775-a58e78301c36)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72175711-4c81-4755-b3fa-09b27152894a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72175711-4c81-4755-b3fa-09b27152894a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (633b153a-0fa5-4bf3-872f-81edb0982516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (633b153a-0fa5-4bf3-872f-81edb0982516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cdbc579b-e301-45a2-ad99-cf2669cd0ca8', 'volume_name': 'volume-cdbc579b-e301-45a2-ad99-cf2669cd0ca8', 'volume_size': 1, 'snapshot_id': '37841246-192c-4f28-8ecb-98e4327a30df'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4679eba-0853-407a-b383-27a3c0c65474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4679eba-0853-407a-b383-27a3c0c65474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74613f2f-a01b-4966-ae04-a9a4c1a68127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:25:29 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Volume cdbc579b-e301-45a2-ad99-cf2669cd0ca8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cdbc579b-e301-45a2-ad99-cf2669cd0ca8', 'volume_size': 1, 'snapshot_id': '37841246-192c-4f28-8ecb-98e4327a30df'}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Acquiring lock "cinder-quobyte-37841246-192c-4f28-8ecb-98e4327a30df-cdbc579b-e301-45a2-ad99-cf2669cd0ca8" by "_create_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Lock "cinder-quobyte-37841246-192c-4f28-8ecb-98e4327a30df-cdbc579b-e301-45a2-ad99-cf2669cd0ca8" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Creating volume cdbc579b-e301-45a2-ad99-cf2669cd0ca8 from snapshot 37841246-192c-4f28-8ecb-98e4327a30df {{(pid=87150) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Selected osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Acquiring lock "cinder-quobyte-cdbc579b-e301-45a2-ad99-cf2669cd0ca8" by "_copy_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Lock "cinder-quobyte-cdbc579b-e301-45a2-ad99-cf2669cd0ca8" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] snapshot: 37841246-192c-4f28-8ecb-98e4327a30df, volume: cdbc579b-e301-45a2-ad99-cf2669cd0ca8,  {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb8424b-6299-429a-a8ea-34f25475e8c4]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.37841246-192c-4f28-8ecb-98e4327a30df {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:29 devstack sudo[108885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.37841246-192c-4f28-8ecb-98e4327a30df
Nov 05 15:25:29 devstack sudo[108885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:29 devstack sudo[108885]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.37841246-192c-4f28-8ecb-98e4327a30df" returned: 0 in 0.341s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a674c778-d9f5-437a-b74d-bb56114b0d01]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:29 devstack sudo[108891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a
Nov 05 15:25:29 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:29 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a" returned: 0 in 0.344s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Creating direct copy from snapshot {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG cinder.utils [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Path /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cdbc579b-e301-45a2-ad99-cf2669cd0ca8 not found in is_blk_device check {{(pid=87150) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 15:25:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cdbc579b-e301-45a2-ad99-cf2669cd0ca8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:29 devstack sudo[108896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cdbc579b-e301-45a2-ad99-cf2669cd0ca8
Nov 05 15:25:29 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:35 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cdbc579b-e301-45a2-ad99-cf2669cd0ca8" returned: 0 in 5.891s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:35 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Image conversion details: src /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cdbc579b-e301-45a2-ad99-cf2669cd0ca8 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 15:25:35 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Converted 1024.00 MB image at 173.79 MB/s
Nov 05 15:25:35 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cdbc579b-e301-45a2-ad99-cf2669cd0ca8 is being set with open permissions: ugo+rw
Nov 05 15:25:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cdbc579b-e301-45a2-ad99-cf2669cd0ca8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:35 devstack sudo[108909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cdbc579b-e301-45a2-ad99-cf2669cd0ca8
Nov 05 15:25:35 devstack sudo[108909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:36 devstack sudo[108909]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cdbc579b-e301-45a2-ad99-cf2669cd0ca8" returned: 0 in 0.237s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Lock "cinder-quobyte-cdbc579b-e301-45a2-ad99-cf2669cd0ca8" released by "_copy_volume_from_snapshot" :: held 6.894s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:25:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Lock "cinder-quobyte-37841246-192c-4f28-8ecb-98e4327a30df-cdbc579b-e301-45a2-ad99-cf2669cd0ca8" released by "_create_volume_from_snapshot" :: held 6.952s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:25:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.967s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:25:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74613f2f-a01b-4966-ae04-a9a4c1a68127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdbc579b-e301-45a2-ad99-cf2669cd0ca8', 'volume_size': 1, 'snapshot_id': '37841246-192c-4f28-8ecb-98e4327a30df'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:25:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56df7e7-0eda-481d-8a87-88f383f79c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 15:25:36 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Volume volume-cdbc579b-e301-45a2-ad99-cf2669cd0ca8 (cdbc579b-e301-45a2-ad99-cf2669cd0ca8): created successfully
Nov 05 15:25:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56df7e7-0eda-481d-8a87-88f383f79c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 15:25:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Flow 'volume_create_manager' (09e51df3-4b3c-45d3-af93-aa58e2238e76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 15:25:36 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-338fe713-bdb5-4cfc-b13e-0edd811c36dc tempest-SnapshotDependencyTests-373200153 None] Created volume successfully.
Nov 05 15:25:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8a6beab9-9ca7-4bfd-8fce-c06c1745a582 tempest-SnapshotDependencyTests-373200153 None] Acquiring lock "cinder-37841246-192c-4f28-8ecb-98e4327a30df-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:25:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8a6beab9-9ca7-4bfd-8fce-c06c1745a582 tempest-SnapshotDependencyTests-373200153 None] Lock "cinder-37841246-192c-4f28-8ecb-98e4327a30df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:25:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8a6beab9-9ca7-4bfd-8fce-c06c1745a582 tempest-SnapshotDependencyTests-373200153 None] Acquiring lock "cinder-quobyte-151f70d4-c9cb-4b4e-aea3-4d3e8042518a" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:25:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8a6beab9-9ca7-4bfd-8fce-c06c1745a582 tempest-SnapshotDependencyTests-373200153 None] Lock "cinder-quobyte-151f70d4-c9cb-4b4e-aea3-4d3e8042518a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:25:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8a6beab9-9ca7-4bfd-8fce-c06c1745a582 tempest-SnapshotDependencyTests-373200153 None] Acquiring lock "cinder-quobyte-37841246-192c-4f28-8ecb-98e4327a30df" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:25:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8a6beab9-9ca7-4bfd-8fce-c06c1745a582 tempest-SnapshotDependencyTests-373200153 None] Lock "cinder-quobyte-37841246-192c-4f28-8ecb-98e4327a30df" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:25:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-8a6beab9-9ca7-4bfd-8fce-c06c1745a582 tempest-SnapshotDependencyTests-373200153 None] Deleting offline snapshot 37841246-192c-4f28-8ecb-98e4327a30df of volume 151f70d4-c9cb-4b4e-aea3-4d3e8042518a {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 15:25:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-8a6beab9-9ca7-4bfd-8fce-c06c1745a582 tempest-SnapshotDependencyTests-373200153 None] snapshot_file for this snap is: volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.37841246-192c-4f28-8ecb-98e4327a30df {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 15:25:36 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b397a4-f110-4956-b83d-1c399c52f76d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:25:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8a6beab9-9ca7-4bfd-8fce-c06c1745a582 tempest-SnapshotDependencyTests-373200153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.37841246-192c-4f28-8ecb-98e4327a30df {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:36 devstack sudo[108912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.37841246-192c-4f28-8ecb-98e4327a30df
Nov 05 15:25:36 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:37 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8a6beab9-9ca7-4bfd-8fce-c06c1745a582 tempest-SnapshotDependencyTests-373200153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.37841246-192c-4f28-8ecb-98e4327a30df" returned: 0 in 0.354s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-8a6beab9-9ca7-4bfd-8fce-c06c1745a582 tempest-SnapshotDependencyTests-373200153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 15:25:37 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[506f90b6-8b35-4de7-a476-3f7f4d91b602]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:25:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8a6beab9-9ca7-4bfd-8fce-c06c1745a582 tempest-SnapshotDependencyTests-373200153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:37 devstack sudo[108917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a
Nov 05 15:25:37 devstack sudo[108917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:25:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:25:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:25:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:25:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:25:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:25:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:37 devstack sudo[108921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:25:37 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:37 devstack sudo[108917]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8a6beab9-9ca7-4bfd-8fce-c06c1745a582 tempest-SnapshotDependencyTests-373200153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a" returned: 0 in 0.515s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8a6beab9-9ca7-4bfd-8fce-c06c1745a582 tempest-SnapshotDependencyTests-373200153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.37841246-192c-4f28-8ecb-98e4327a30df {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:37 devstack sudo[108924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.37841246-192c-4f28-8ecb-98e4327a30df
Nov 05 15:25:37 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:37 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.254s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:25:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 15:25:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 15:25:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-661e90ae-d23e-4ae5-9f9c-761c80945a48 None None] thread info: [<_MainThread(MainThread, started 136317437956224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136317326340928)>, <Thread(Thread-3 (stat_writer), started daemon 136317326487936)>, <Thread(Rabbit-heartbeat, started daemon 136317321464000)>, <Thread(Thread-5 (_runner), started daemon 136317321550592)>, <Thread(Thread-7 (_runner), started daemon 136317321658496)>, <Thread(fd_logger, started daemon 136317319612992)>, <Thread(privsep_reader, started daemon 136317319622400)>, <Thread(tpool_thread_0, started daemon 136317310928576)>, <Thread(tpool_thread_1, started daemon 136317302535872)>, <Thread(tpool_thread_2, started daemon 136317294143168)>, <Thread(tpool_thread_3, started daemon 136317285750464)>, <Thread(tpool_thread_4, started daemon 136317277357760)>, <Thread(tpool_thread_5, started daemon 136317268965056)>, <Thread(tpool_thread_6, started daemon 136317260572352)>, <Thread(tpool_thread_7, started daemon 136317252179648)>, <Thread(tpool_thread_8, started daemon 136317243786944)>, <Thread(tpool_thread_9, started daemon 136317235394240)>, <Thread(tpool_thread_10, started daemon 136317227001536)>, <Thread(tpool_thread_11, started daemon 136317218608832)>, <Thread(tpool_thread_12, started daemon 136317210216128)>, <Thread(tpool_thread_13, started daemon 136317201807040)>, <Thread(tpool_thread_14, started daemon 136317193397952)>, <Thread(tpool_thread_15, started daemon 136317184988864)>, <Thread(tpool_thread_16, started daemon 136317176579776)>, <Thread(tpool_thread_17, started daemon 136317168170688)>, <Thread(tpool_thread_18, started daemon 136317159761600)>, <Thread(tpool_thread_19, started daemon 136317151352512)>] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 15:25:37 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8a6beab9-9ca7-4bfd-8fce-c06c1745a582 tempest-SnapshotDependencyTests-373200153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.37841246-192c-4f28-8ecb-98e4327a30df" returned: 0 in 0.335s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8a6beab9-9ca7-4bfd-8fce-c06c1745a582 tempest-SnapshotDependencyTests-373200153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.37841246-192c-4f28-8ecb-98e4327a30df {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:37 devstack sudo[108931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.37841246-192c-4f28-8ecb-98e4327a30df
Nov 05 15:25:37 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:38 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8a6beab9-9ca7-4bfd-8fce-c06c1745a582 tempest-SnapshotDependencyTests-373200153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a.37841246-192c-4f28-8ecb-98e4327a30df" returned: 0 in 0.235s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8a6beab9-9ca7-4bfd-8fce-c06c1745a582 tempest-SnapshotDependencyTests-373200153 None] Lock "cinder-quobyte-37841246-192c-4f28-8ecb-98e4327a30df" released by "_delete_snapshot" :: held 1.536s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:25:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8a6beab9-9ca7-4bfd-8fce-c06c1745a582 tempest-SnapshotDependencyTests-373200153 None] Lock "cinder-quobyte-151f70d4-c9cb-4b4e-aea3-4d3e8042518a" released by "delete_snapshot" :: held 1.558s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:25:38 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-8a6beab9-9ca7-4bfd-8fce-c06c1745a582 tempest-SnapshotDependencyTests-373200153 None] Created reservations ['5fa6a03f-46c4-4b8b-8417-2ee1e82c8b66', '8acd0d57-5076-437c-aedc-60f2df95f09a', '45784ef7-21fc-4ab8-b57f-80a20a9f08f5', '36459533-5a67-46e2-93d8-2f9f981b89ff'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:25:38 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-8a6beab9-9ca7-4bfd-8fce-c06c1745a582 tempest-SnapshotDependencyTests-373200153 None] Delete snapshot completed successfully.
Nov 05 15:25:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8a6beab9-9ca7-4bfd-8fce-c06c1745a582 tempest-SnapshotDependencyTests-373200153 None] Lock "cinder-37841246-192c-4f28-8ecb-98e4327a30df-delete_snapshot" released by "delete_snapshot" :: held 1.683s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:25:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a133af62-c0f6-43c7-b5d1-294585079d9f tempest-SnapshotDependencyTests-373200153 None] Acquiring lock "cinder-151f70d4-c9cb-4b4e-aea3-4d3e8042518a-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:25:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a133af62-c0f6-43c7-b5d1-294585079d9f tempest-SnapshotDependencyTests-373200153 None] Lock "cinder-151f70d4-c9cb-4b4e-aea3-4d3e8042518a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:25:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a133af62-c0f6-43c7-b5d1-294585079d9f tempest-SnapshotDependencyTests-373200153 None] Acquiring lock "cinder-quobyte-151f70d4-c9cb-4b4e-aea3-4d3e8042518a" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:25:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a133af62-c0f6-43c7-b5d1-294585079d9f tempest-SnapshotDependencyTests-373200153 None] Lock "cinder-quobyte-151f70d4-c9cb-4b4e-aea3-4d3e8042518a" acquired by "delete_volume" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:25:38 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a853f9d6-a6b5-45aa-8bb9-5a1ccd4aa07c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:25:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a133af62-c0f6-43c7-b5d1-294585079d9f tempest-SnapshotDependencyTests-373200153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:38 devstack sudo[108934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a
Nov 05 15:25:38 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:39 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a133af62-c0f6-43c7-b5d1-294585079d9f tempest-SnapshotDependencyTests-373200153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a" returned: 0 in 0.350s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a133af62-c0f6-43c7-b5d1-294585079d9f tempest-SnapshotDependencyTests-373200153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:39 devstack sudo[108939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a
Nov 05 15:25:39 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:39 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a133af62-c0f6-43c7-b5d1-294585079d9f tempest-SnapshotDependencyTests-373200153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-151f70d4-c9cb-4b4e-aea3-4d3e8042518a" returned: 0 in 0.237s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a133af62-c0f6-43c7-b5d1-294585079d9f tempest-SnapshotDependencyTests-373200153 None] Lock "cinder-quobyte-151f70d4-c9cb-4b4e-aea3-4d3e8042518a" released by "delete_volume" :: held 0.646s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:25:39 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-a133af62-c0f6-43c7-b5d1-294585079d9f tempest-SnapshotDependencyTests-373200153 None] Created reservations ['7f1ad3b3-380b-4b9d-a953-0a57eeb7ba84', 'b7a6f9c5-0785-47de-a360-2587d812bfd9', '2af8ed82-a908-4a00-a65b-8059109a1673', 'd0ad8292-bacf-420c-865c-3c3dff896965'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:25:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a133af62-c0f6-43c7-b5d1-294585079d9f tempest-SnapshotDependencyTests-373200153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:25:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a133af62-c0f6-43c7-b5d1-294585079d9f tempest-SnapshotDependencyTests-373200153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:25:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a133af62-c0f6-43c7-b5d1-294585079d9f tempest-SnapshotDependencyTests-373200153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:25:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a133af62-c0f6-43c7-b5d1-294585079d9f tempest-SnapshotDependencyTests-373200153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:25:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a133af62-c0f6-43c7-b5d1-294585079d9f tempest-SnapshotDependencyTests-373200153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:25:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a133af62-c0f6-43c7-b5d1-294585079d9f tempest-SnapshotDependencyTests-373200153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:39 devstack sudo[108943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:25:39 devstack sudo[108943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:39 devstack sudo[108943]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a133af62-c0f6-43c7-b5d1-294585079d9f tempest-SnapshotDependencyTests-373200153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.247s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:39 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a133af62-c0f6-43c7-b5d1-294585079d9f tempest-SnapshotDependencyTests-373200153 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:25:39 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a133af62-c0f6-43c7-b5d1-294585079d9f tempest-SnapshotDependencyTests-373200153 None] Deleted volume successfully.
Nov 05 15:25:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a133af62-c0f6-43c7-b5d1-294585079d9f tempest-SnapshotDependencyTests-373200153 None] Lock "cinder-151f70d4-c9cb-4b4e-aea3-4d3e8042518a-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:25:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c6b05cde-a1f4-41ef-8805-d02f0dbae7da tempest-SnapshotDependencyTests-373200153 None] Acquiring lock "cinder-cdbc579b-e301-45a2-ad99-cf2669cd0ca8-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:25:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c6b05cde-a1f4-41ef-8805-d02f0dbae7da tempest-SnapshotDependencyTests-373200153 None] Lock "cinder-cdbc579b-e301-45a2-ad99-cf2669cd0ca8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:25:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c6b05cde-a1f4-41ef-8805-d02f0dbae7da tempest-SnapshotDependencyTests-373200153 None] Acquiring lock "cinder-quobyte-cdbc579b-e301-45a2-ad99-cf2669cd0ca8" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 15:25:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c6b05cde-a1f4-41ef-8805-d02f0dbae7da tempest-SnapshotDependencyTests-373200153 None] Lock "cinder-quobyte-cdbc579b-e301-45a2-ad99-cf2669cd0ca8" acquired by "delete_volume" :: waited 0.013s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 15:25:39 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b2a807-d9bb-498b-94e3-a6407a5926a2]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 15:25:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c6b05cde-a1f4-41ef-8805-d02f0dbae7da tempest-SnapshotDependencyTests-373200153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cdbc579b-e301-45a2-ad99-cf2669cd0ca8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:40 devstack sudo[108946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cdbc579b-e301-45a2-ad99-cf2669cd0ca8
Nov 05 15:25:40 devstack sudo[108946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:40 devstack sudo[108946]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c6b05cde-a1f4-41ef-8805-d02f0dbae7da tempest-SnapshotDependencyTests-373200153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cdbc579b-e301-45a2-ad99-cf2669cd0ca8" returned: 0 in 0.392s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c6b05cde-a1f4-41ef-8805-d02f0dbae7da tempest-SnapshotDependencyTests-373200153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cdbc579b-e301-45a2-ad99-cf2669cd0ca8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:40 devstack sudo[108952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cdbc579b-e301-45a2-ad99-cf2669cd0ca8
Nov 05 15:25:40 devstack sudo[108952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:40 devstack sudo[108952]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c6b05cde-a1f4-41ef-8805-d02f0dbae7da tempest-SnapshotDependencyTests-373200153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d/volume-cdbc579b-e301-45a2-ad99-cf2669cd0ca8" returned: 0 in 0.256s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c6b05cde-a1f4-41ef-8805-d02f0dbae7da tempest-SnapshotDependencyTests-373200153 None] Lock "cinder-quobyte-cdbc579b-e301-45a2-ad99-cf2669cd0ca8" released by "delete_volume" :: held 0.689s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:25:40 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-c6b05cde-a1f4-41ef-8805-d02f0dbae7da tempest-SnapshotDependencyTests-373200153 None] Created reservations ['b2516d40-5472-44bc-ab2a-a36951b3eb52', 'b17612bb-2e0d-4a3a-ac4c-0371deb10919', '7dba7ba2-99ed-41c7-a9ba-cb1c92f9748b', '489af4c0-9fb8-4c77-921a-945e6b8b55f4'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 15:25:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c6b05cde-a1f4-41ef-8805-d02f0dbae7da tempest-SnapshotDependencyTests-373200153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 15:25:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c6b05cde-a1f4-41ef-8805-d02f0dbae7da tempest-SnapshotDependencyTests-373200153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 15:25:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c6b05cde-a1f4-41ef-8805-d02f0dbae7da tempest-SnapshotDependencyTests-373200153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 15:25:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c6b05cde-a1f4-41ef-8805-d02f0dbae7da tempest-SnapshotDependencyTests-373200153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b50436ee-3b8b-4bc1-99f1-ba903e483628'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 15:25:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c6b05cde-a1f4-41ef-8805-d02f0dbae7da tempest-SnapshotDependencyTests-373200153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 15:25:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c6b05cde-a1f4-41ef-8805-d02f0dbae7da tempest-SnapshotDependencyTests-373200153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 15:25:40 devstack sudo[108955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d
Nov 05 15:25:40 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 15:25:40 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root
Nov 05 15:25:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c6b05cde-a1f4-41ef-8805-d02f0dbae7da tempest-SnapshotDependencyTests-373200153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6b22e2b4a066d1eeab8aaba8ec87c52d" returned: 0 in 0.247s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 15:25:40 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-c6b05cde-a1f4-41ef-8805-d02f0dbae7da tempest-SnapshotDependencyTests-373200153 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 15:25:41 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c6b05cde-a1f4-41ef-8805-d02f0dbae7da tempest-SnapshotDependencyTests-373200153 None] Deleted volume successfully.
Nov 05 15:25:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c6b05cde-a1f4-41ef-8805-d02f0dbae7da tempest-SnapshotDependencyTests-373200153 None] Lock "cinder-cdbc579b-e301-45a2-ad99-cf2669cd0ca8-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 15:25:50 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=26,cinder:UPDATE=27,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 15:25:51 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=31,cinder:SELECT=23,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}